2019-12-22T21:56:21.662 INFO:root:teuthology version: 1.0.0-744c324 2019-12-22T21:56:21.662 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.TyETCy.tmp -- --verbose --lock --description rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml u.yaml workloads/snaps-few-objects.yaml} --name sage-2019-12-22_21:54:24-rados:thrash-old-clients-wip-sage-testing-2019-12-22-0931-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2019-12-22_21:54:24-rados:thrash-old-clients-wip-sage-testing-2019-12-22-0931-distro-basic-smithi/4626397 2019-12-22T21:56:21.749 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-22T21:56:21.811 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2019-12-22_21:54:24-rados:thrash-old-clients-wip-sage-testing-2019-12-22-0931-distro-basic-smithi/4626397 branch: wip-sage-testing-2019-12-22-0931 description: rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml u.yaml workloads/snaps-few-objects.yaml} email: null first_in_suite: false job_id: '4626397' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2019-12-22_21:54:24-rados:thrash-old-clients-wip-sage-testing-2019-12-22-0931-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - volumes: count: 4 size: 10 os_type: centos os_version: '7.6' overrides: admin_socket: branch: wip-sage-testing-2019-12-22-0931 ceph: conf: global: mon client directed command retry: 5 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 3 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd backoff on peering: true osd debug verify cached snaps: true osd debug verify missing on start: true osd map cache size: 1 osd max backfills: 6 osd op queue: debug_random osd op queue cut off: debug_random osd scrub during recovery: false osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - osd_map_cache_size - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow requests mon_bind_msgr2: false sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 thrashosds: min_in: 4 workunit: branch: wip-old-clients-cephadm sha1: abe4c1c94873149a777c88f919a579d57de0f422 owner: scheduled_sage@teuthology priority: 30 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - - mon.c - osd.8 - osd.9 - osd.10 - osd.11 - client.2 sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 suite: rados:thrash-old-clients suite_branch: wip-old-clients-cephadm suite_path: /home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: abe4c1c94873149a777c88f919a579d57de0f422 tasks: - install: branch: jewel exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-diskprediction-cloud - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-mgr - libcephfs2 - libcephfs-devel - libcephfs-dev - ceph-immutable-object-cache - ceph-base - librados-devel - python3-rados - python3-rgw - python3-rbd - python3-cephfs extra_packages: - librados2 - python-rados - python-rbd - python-cephfs - cephadm: null - thrashosds: chance_pgnum_grow: 0.25 chance_pgpnum_fix: 0.25 chance_test_map_discontinuity: 2 timeout: 1800 - sleep: duration: 600000 - rados: clients: - client.2 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.8223 2019-12-22T21:56:21.811 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa; will attempt to use it 2019-12-22T21:56:21.813 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks 2019-12-22T21:56:21.813 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-22T21:56:21.816 INFO:teuthology.task.internal:Checking packages... 2019-12-22T21:56:21.846 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '99b509ffd4dd354919b08b38ba83b998fbfdc107' 2019-12-22T21:56:21.846 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T21:56:21.847 INFO:teuthology.packaging:ref: None 2019-12-22T21:56:21.847 INFO:teuthology.packaging:tag: None 2019-12-22T21:56:21.847 INFO:teuthology.packaging:branch: wip-sage-testing-2019-12-22-0931 2019-12-22T21:56:21.847 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T21:56:21.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-sage-testing-2019-12-22-0931 2019-12-22T21:56:22.010 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-8807.g99b509f 2019-12-22T21:56:22.010 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-22T21:56:22.059 INFO:teuthology.task.internal:no buildpackages task found 2019-12-22T21:56:22.059 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-22T21:56:22.071 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-22T21:56:22.071 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-22T21:56:22.116 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:56:32.133 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:56:42.151 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:56:52.169 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:57:02.185 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:57:12.202 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:57:22.221 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:57:32.239 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:57:42.252 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:57:52.269 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:58:02.290 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:58:12.307 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:58:22.348 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:58:32.363 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:58:42.380 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:58:52.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:59:02.420 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:59:12.437 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:59:22.453 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:59:32.468 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:59:42.484 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T21:59:52.506 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:00:02.520 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:00:12.537 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:00:22.552 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:00:32.567 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:00:42.584 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-22T22:00:52.605 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-22T22:01:02.621 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-22T22:01:12.643 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-22T22:01:22.665 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:01:32.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:01:42.696 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:01:52.712 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-22T22:02:02.730 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:02:12.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-22T22:02:22.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:02:32.780 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:02:42.798 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:02:52.812 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:03:02.829 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:03:12.848 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:03:22.865 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:03:32.876 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:03:42.887 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:03:52.919 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:04:02.939 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:04:12.976 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:04:23.011 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:04:33.029 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:04:43.046 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:04:53.064 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:05:03.079 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-22T22:05:13.097 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2019-12-22_21:54:24-rados:thrash-old-clients-wip-sage-testing-2019-12-22-0931-distro-basic-smithi/4626397', 'machine_type': 'smithi'} 2019-12-22T22:05:13.120 DEBUG:teuthology.lock.ops:locked ubuntu@smithi168.front.sepia.ceph.com, ubuntu@smithi187.front.sepia.ceph.com, ubuntu@smithi071.front.sepia.ceph.com 2019-12-22T22:05:13.234 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-22T22:05:13.464 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 7.6 2019-12-22T22:05:13.467 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 7.6 2019-12-22T22:05:13.472 INFO:teuthology.provision.fog.smithi168:Scheduling deploy of centos 7.6 2019-12-22T22:05:13.860 INFO:teuthology.orchestra.console:Power off smithi071 2019-12-22T22:05:13.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-22T22:05:13.889 INFO:teuthology.orchestra.console:Power off smithi187 2019-12-22T22:05:13.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-22T22:05:13.914 INFO:teuthology.orchestra.console:Power off smithi168 2019-12-22T22:05:13.914 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-22T22:05:13.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:13.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:13.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:14.069 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2019-12-22T22:05:14.161 INFO:teuthology.orchestra.console:Power off for smithi168 completed 2019-12-22T22:05:14.170 INFO:teuthology.orchestra.console:Power on smithi187 2019-12-22T22:05:14.171 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-22T22:05:14.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:14.262 INFO:teuthology.orchestra.console:Power on smithi168 2019-12-22T22:05:14.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-22T22:05:14.290 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:17.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:18.251 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:18.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:18.527 INFO:teuthology.orchestra.console:Power on for smithi168 completed 2019-12-22T22:05:18.628 INFO:teuthology.provision.fog.smithi168:Waiting for deploy to finish 2019-12-22T22:05:22.098 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:22.314 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2019-12-22T22:05:22.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:22.416 INFO:teuthology.orchestra.console:Power on smithi071 2019-12-22T22:05:22.417 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-22T22:05:22.438 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:22.575 INFO:teuthology.orchestra.console:Power on for smithi187 completed 2019-12-22T22:05:22.676 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2019-12-22T22:05:26.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:30.578 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-22T22:05:30.789 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2019-12-22T22:05:30.890 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2019-12-22T22:07:53.783 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:03.018 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:04.854 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:12.075 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:13.929 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:17.159 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:21.130 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:22.986 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:26.217 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:30.186 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:32.042 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:35.278 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:39.242 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:41.098 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:44.393 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:48.298 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:50.155 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:53.449 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:57.358 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:08:59.210 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:09:02.505 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:09:08.266 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:09:11.566 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:09:20.622 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:09:29.001 INFO:teuthology.orchestra.run.smithi187:> hostname 2019-12-22T22:09:29.444 INFO:teuthology.orchestra.run.smithi187.stdout:smithi068 2019-12-22T22:09:29.445 INFO:teuthology.orchestra.run.smithi187:> grep smithi068 /etc/hosts 2019-12-22T22:09:29.496 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-12-22T22:09:29.497 INFO:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2019-12-22T22:09:29.617 INFO:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi068/smithi187/g' /etc/hosts 2019-12-22T22:09:29.675 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:09:29.696 INFO:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.68/172.21.15.187/g' /etc/hosts 2019-12-22T22:09:29.760 INFO:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi068/smithi187/g' /etc/hostname 2019-12-22T22:09:29.814 INFO:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2019-12-22T22:09:29.870 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2019-12-22T22:09:29.872 DEBUG:teuthology.parallel:result is None 2019-12-22T22:09:54.221 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:03.277 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:09.281 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:09.481 INFO:teuthology.orchestra.run.smithi071:> hostname 2019-12-22T22:10:09.958 INFO:teuthology.orchestra.run.smithi071.stdout:smithi068 2019-12-22T22:10:09.959 INFO:teuthology.orchestra.run.smithi071:> grep smithi068 /etc/hosts 2019-12-22T22:10:10.001 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-12-22T22:10:10.001 INFO:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2019-12-22T22:10:10.159 INFO:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi068/smithi071/g' /etc/hosts 2019-12-22T22:10:10.217 INFO:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.68/172.21.15.71/g' /etc/hosts 2019-12-22T22:10:10.269 INFO:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi068/smithi071/g' /etc/hostname 2019-12-22T22:10:10.333 INFO:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2019-12-22T22:10:10.385 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2019-12-22T22:10:10.387 DEBUG:teuthology.parallel:result is None 2019-12-22T22:10:14.269 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:14.454 INFO:teuthology.orchestra.run.smithi168:> hostname 2019-12-22T22:10:15.024 INFO:teuthology.orchestra.run.smithi168.stdout:smithi168.front.sepia.ceph.com 2019-12-22T22:10:15.024 INFO:teuthology.orchestra.run.smithi168:> grep smithi168.front.sepia.ceph.com /etc/hosts 2019-12-22T22:10:15.109 INFO:teuthology.orchestra.run.smithi168.stdout:172.21.15.168 smithi168.front.sepia.ceph.com smithi168 2019-12-22T22:10:15.110 INFO:teuthology.orchestra.run.smithi168:> sudo hostname smithi168 2019-12-22T22:10:15.267 INFO:teuthology.orchestra.run.smithi168:> sudo sed -i -e 's/smithi168.front.sepia.ceph.com/smithi168/g' /etc/hosts 2019-12-22T22:10:15.380 INFO:teuthology.orchestra.run.smithi168:> sudo sed -i -e 's/172.21.15.168/172.21.15.168/g' /etc/hosts 2019-12-22T22:10:15.464 INFO:teuthology.orchestra.run.smithi168:> sudo sed -i -e 's/smithi168.front.sepia.ceph.com/smithi168/g' /etc/hostname 2019-12-22T22:10:15.536 INFO:teuthology.orchestra.run.smithi168:> sudo hostname smithi168 2019-12-22T22:10:15.602 INFO:teuthology.provision.fog.smithi168:Deploy complete! 2019-12-22T22:10:15.605 DEBUG:teuthology.parallel:result is None 2019-12-22T22:10:15.826 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2019-12-22T22:10:15.826 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-22T22:10:15.842 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2019-12-22T22:10:15.843 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-22T22:10:15.853 INFO:teuthology.lock.ops:Checking smithi168.front.sepia.ceph.com 2019-12-22T22:10:15.862 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-22T22:10:15.882 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2019-12-22T22:10:15.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:10:15.883 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:16.026 INFO:teuthology.orchestra.run.smithi071:> true 2019-12-22T22:10:16.355 INFO:teuthology.orchestra.run.smithi071:> uname -m 2019-12-22T22:10:16.398 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2019-12-22T22:10:16.398 INFO:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2019-12-22T22:10:16.439 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Linux" 2019-12-22T22:10:16.439 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="7 (Core)" 2019-12-22T22:10:16.439 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2019-12-22T22:10:16.439 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2019-12-22T22:10:16.439 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="7" 2019-12-22T22:10:16.440 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-22T22:10:16.440 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2019-12-22T22:10:16.440 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-22T22:10:16.440 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.centos.org/" 2019-12-22T22:10:16.440 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-22T22:10:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:10:16.441 INFO:teuthology.orchestra.run.smithi071.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-22T22:10:16.441 INFO:teuthology.orchestra.run.smithi071.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-22T22:10:16.441 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-22T22:10:16.441 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-22T22:10:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:10:16.442 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2019-12-22T22:10:16.461 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2019-12-22T22:10:16.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:10:16.461 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:16.568 INFO:teuthology.orchestra.run.smithi187:> true 2019-12-22T22:10:16.958 INFO:teuthology.orchestra.run.smithi187:> uname -m 2019-12-22T22:10:17.043 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2019-12-22T22:10:17.044 INFO:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2019-12-22T22:10:17.108 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Linux" 2019-12-22T22:10:17.109 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="7 (Core)" 2019-12-22T22:10:17.109 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2019-12-22T22:10:17.109 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2019-12-22T22:10:17.109 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="7" 2019-12-22T22:10:17.109 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-22T22:10:17.109 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2019-12-22T22:10:17.110 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-22T22:10:17.110 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.centos.org/" 2019-12-22T22:10:17.110 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-22T22:10:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:10:17.110 INFO:teuthology.orchestra.run.smithi187.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-22T22:10:17.110 INFO:teuthology.orchestra.run.smithi187.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-22T22:10:17.110 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-22T22:10:17.111 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-22T22:10:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:10:17.111 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2019-12-22T22:10:17.127 INFO:teuthology.lock.ops:Updating [smithi168.front.sepia.ceph.com]: set os type and version on server 2019-12-22T22:10:17.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:10:17.127 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:17.245 INFO:teuthology.orchestra.run.smithi168:> true 2019-12-22T22:10:17.620 INFO:teuthology.orchestra.run.smithi168:> uname -m 2019-12-22T22:10:17.703 INFO:teuthology.orchestra.run.smithi168.stdout:x86_64 2019-12-22T22:10:17.703 INFO:teuthology.orchestra.run.smithi168:> cat /etc/os-release 2019-12-22T22:10:17.769 INFO:teuthology.orchestra.run.smithi168.stdout:NAME="CentOS Linux" 2019-12-22T22:10:17.770 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION="7 (Core)" 2019-12-22T22:10:17.770 INFO:teuthology.orchestra.run.smithi168.stdout:ID="centos" 2019-12-22T22:10:17.770 INFO:teuthology.orchestra.run.smithi168.stdout:ID_LIKE="rhel fedora" 2019-12-22T22:10:17.770 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION_ID="7" 2019-12-22T22:10:17.770 INFO:teuthology.orchestra.run.smithi168.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-22T22:10:17.770 INFO:teuthology.orchestra.run.smithi168.stdout:ANSI_COLOR="0;31" 2019-12-22T22:10:17.770 INFO:teuthology.orchestra.run.smithi168.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-22T22:10:17.771 INFO:teuthology.orchestra.run.smithi168.stdout:HOME_URL="https://www.centos.org/" 2019-12-22T22:10:17.771 INFO:teuthology.orchestra.run.smithi168.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-22T22:10:17.771 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:10:17.771 INFO:teuthology.orchestra.run.smithi168.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-22T22:10:17.771 INFO:teuthology.orchestra.run.smithi168.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-22T22:10:17.771 INFO:teuthology.orchestra.run.smithi168.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-22T22:10:17.771 INFO:teuthology.orchestra.run.smithi168.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-22T22:10:17.772 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:10:17.772 INFO:teuthology.lock.ops:Updating smithi168.front.sepia.ceph.com on lock server 2019-12-22T22:10:17.788 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2019-12-22T22:10:17.831 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCeySTbvlK/TZDm2ST4gqFkXhpuGX37UwB5PgVW/gD/1DF1KsDLqZPmi+Oou6UqGfmUex4ZQMnJH7pzmalL6PfJelm4AGeZXdrf+NzdESSaMR4JI7MW8QU020t1kOR0lEh3NOShlvP/qdKxCkzNXju2tGuz/BW5euqj/tvBQm+sPQ1/3jt9fwqcxxbjrU4wt76Pw2rVNQ60LZMdioWCb6MdGwlkc8FhjV8YmbTpG2q/JwORytWUOfZTaNzmH7R63p1GDfku6YrU5CC1l4HTYRMn/ufn5MBS850TDcJGhQAm6EoZ6ybPdzgmKHDyDIuxPo3NcOgdjHFRHpLog3fjhMP smithi168.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCRd8oXca+p866HodNEod/+YW++gmB9OviLuPqmWKMi2KcnQIKtQ/3ZVX74EOwoHtnTtTiwBWqjlgZa+CprTcYylt5A0YBInncYop5hcz4BWi8WPXdlWmdgk1FwI4Xks1E5ZHoay0+pytSOtjrNvWK6MHYlT4SgZkHpkatdAa46yZnWaz7oY+S7FX/3JXqo42v1CfD1itWUVCA3Iy8g7iLtktOXc0qCxhZSlVUGxR/aWp2v0Fw2s+rABNSA8kwj67PaXsdjNQ46B+D6OVmaMcageZhJ2aQgSiUsQEeppCHQ767a5GyJtmYcKHw3S0JqtKX/C+06zsAMDvH+evxPDwNf smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/Zwp+GxxM2ClQyEjLI7tSH4r/Dq2fLxfApwbN9dhm3pBh7d3WJ6tHalFu0RzwOfdYHLCCSpx7+391gnsmSw+KecnflpDMN6Sf2SFWxTpCT7bsf3UG0jL6R279/uBt184kVgHDL0vVdc3Rl5oMRZzomzfW97sPJ+dupGqBZ5KBqDkQi1MVSZgJ1TYcT3jmGNvNTYOJKQ/hZ/dULNCTVoFAN7o5brwrHj7MgsqfFri4m31FUObJP2lcTzwyPyWFmWEsrHk1tutLcBYd7yfnPJdZEF64J4XqzhRIqqPLH/k+QrGhbtI3A9rGjr+m/YS6T4I+ESgY1E+3oIV9Hx+dGlLH 2019-12-22T22:10:17.832 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-22T22:10:17.884 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-22T22:10:17.890 INFO:teuthology.task.internal:Saving configuration 2019-12-22T22:10:17.907 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-22T22:10:17.918 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-22T22:10:17.932 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-22 22:05:13.108187', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi071.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJsWG3XF29qb5P93+R0w/a0Esx7pt7JWWB/oQsEAtq2+JqkI0S3KP35NU8lpJd6khyy6DcMTmu744m+IdggLYpk=', u'description': u'/home/teuthworker/archive/sage-2019-12-22_21:54:24-rados:thrash-old-clients-wip-sage-testing-2019-12-22-0931-distro-basic-smithi/4626397'} 2019-12-22T22:10:17.946 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-22 22:05:13.108172', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi187.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOf4w3B60MtGeF4dRMJOnhN+LfAljGradwhWs0XAz0sZ1IvabB+J9je6UA3D1YpEzLGDPLfP+2QWWoMOYFMdPk=', u'description': u'/home/teuthworker/archive/sage-2019-12-22_21:54:24-rados:thrash-old-clients-wip-sage-testing-2019-12-22-0931-distro-basic-smithi/4626397'} 2019-12-22T22:10:17.961 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-22 22:05:13.108152', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi168.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKpOYazY31lAvcxqDunieqDOMDW+lDseexUJTaok8wT6KO76glonBwuJxCwWL1o0L8rMQDJWiODycWZy7NHt8xI=', u'description': u'/home/teuthworker/archive/sage-2019-12-22_21:54:24-rados:thrash-old-clients-wip-sage-testing-2019-12-22-0931-distro-basic-smithi/4626397'} 2019-12-22T22:10:17.962 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-22T22:10:17.981 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-22T22:10:17.982 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-22T22:10:17.982 INFO:teuthology.task.internal:roles: ubuntu@smithi168.front.sepia.ceph.com - ['mon.c', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'client.2'] 2019-12-22T22:10:17.982 INFO:teuthology.run_tasks:Running task console_log... 2019-12-22T22:10:18.089 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-22T22:10:18.089 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-22T22:10:18.133 INFO:teuthology.task.internal:Opening connections... 2019-12-22T22:10:18.133 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi168.front.sepia.ceph.com 2019-12-22T22:10:18.134 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:18.237 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2019-12-22T22:10:18.238 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:18.349 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2019-12-22T22:10:18.350 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:10:18.455 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-22T22:10:18.465 INFO:teuthology.orchestra.run.smithi168:> uname -m 2019-12-22T22:10:18.578 INFO:teuthology.orchestra.run.smithi168.stdout:x86_64 2019-12-22T22:10:18.579 INFO:teuthology.orchestra.run.smithi168:> cat /etc/os-release 2019-12-22T22:10:18.651 INFO:teuthology.orchestra.run.smithi168.stdout:NAME="CentOS Linux" 2019-12-22T22:10:18.651 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION="7 (Core)" 2019-12-22T22:10:18.651 INFO:teuthology.orchestra.run.smithi168.stdout:ID="centos" 2019-12-22T22:10:18.651 INFO:teuthology.orchestra.run.smithi168.stdout:ID_LIKE="rhel fedora" 2019-12-22T22:10:18.652 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION_ID="7" 2019-12-22T22:10:18.652 INFO:teuthology.orchestra.run.smithi168.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-22T22:10:18.652 INFO:teuthology.orchestra.run.smithi168.stdout:ANSI_COLOR="0;31" 2019-12-22T22:10:18.652 INFO:teuthology.orchestra.run.smithi168.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-22T22:10:18.653 INFO:teuthology.orchestra.run.smithi168.stdout:HOME_URL="https://www.centos.org/" 2019-12-22T22:10:18.653 INFO:teuthology.orchestra.run.smithi168.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-22T22:10:18.653 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:10:18.653 INFO:teuthology.orchestra.run.smithi168.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-22T22:10:18.654 INFO:teuthology.orchestra.run.smithi168.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-22T22:10:18.654 INFO:teuthology.orchestra.run.smithi168.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-22T22:10:18.654 INFO:teuthology.orchestra.run.smithi168.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-22T22:10:18.655 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:10:18.655 INFO:teuthology.lock.ops:Updating smithi168.front.sepia.ceph.com on lock server 2019-12-22T22:10:18.670 INFO:teuthology.orchestra.run.smithi071:> uname -m 2019-12-22T22:10:18.736 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2019-12-22T22:10:18.736 INFO:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2019-12-22T22:10:18.778 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Linux" 2019-12-22T22:10:18.778 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="7 (Core)" 2019-12-22T22:10:18.778 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2019-12-22T22:10:18.778 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2019-12-22T22:10:18.779 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="7" 2019-12-22T22:10:18.779 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-22T22:10:18.779 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2019-12-22T22:10:18.779 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-22T22:10:18.779 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.centos.org/" 2019-12-22T22:10:18.780 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-22T22:10:18.780 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:10:18.780 INFO:teuthology.orchestra.run.smithi071.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-22T22:10:18.780 INFO:teuthology.orchestra.run.smithi071.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-22T22:10:18.781 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-22T22:10:18.781 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-22T22:10:18.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:10:18.782 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2019-12-22T22:10:18.796 INFO:teuthology.orchestra.run.smithi187:> uname -m 2019-12-22T22:10:18.919 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2019-12-22T22:10:18.919 INFO:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2019-12-22T22:10:18.987 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Linux" 2019-12-22T22:10:18.987 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="7 (Core)" 2019-12-22T22:10:18.987 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2019-12-22T22:10:18.987 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2019-12-22T22:10:18.988 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="7" 2019-12-22T22:10:18.988 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-22T22:10:18.988 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2019-12-22T22:10:18.988 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-22T22:10:18.988 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.centos.org/" 2019-12-22T22:10:18.988 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-22T22:10:18.988 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:10:18.989 INFO:teuthology.orchestra.run.smithi187.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-22T22:10:18.989 INFO:teuthology.orchestra.run.smithi187.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-22T22:10:18.989 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-22T22:10:18.989 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-22T22:10:18.989 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:10:18.989 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2019-12-22T22:10:19.001 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-22T22:10:19.026 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-22T22:10:19.036 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-22T22:10:19.037 INFO:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2019-12-22T22:10:19.041 INFO:teuthology.orchestra.run.smithi168:> test '!' -e /home/ubuntu/cephtest 2019-12-22T22:10:19.045 INFO:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2019-12-22T22:10:19.135 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-22T22:10:19.193 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-22T22:10:19.193 INFO:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2019-12-22T22:10:19.197 INFO:teuthology.orchestra.run.smithi168:> test -z $(ls -A /var/lib/ceph) 2019-12-22T22:10:19.201 INFO:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2019-12-22T22:10:19.300 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-22T22:10:19.360 INFO:teuthology.run_tasks:Running task kernel... 2019-12-22T22:10:19.379 DEBUG:teuthology.task.kernel:normalized config {'osd.9': {'sha1': 'distro', 'kdb': True}, 'osd.8': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'client.2': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'osd.11': {'sha1': 'distro', 'kdb': True}, 'osd.10': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'mon.a': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-12-22T22:10:19.380 INFO:teuthology.task.kernel:config {'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mon.a': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-22T22:10:19.380 INFO:teuthology.orchestra.run.smithi168:> uname -r 2019-12-22T22:10:19.467 INFO:teuthology.orchestra.run.smithi168.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-22T22:10:19.467 INFO:teuthology.task.kernel:Running kernel on smithi168: 3.10.0-1062.4.1.el7.x86_64 2019-12-22T22:10:19.467 INFO:teuthology.orchestra.run.smithi168:> sudo yum install -y kernel 2019-12-22T22:10:20.297 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:10:20.438 INFO:teuthology.orchestra.run.smithi168.stdout:Determining fastest mirrors 2019-12-22T22:10:21.273 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.umd.edu 2019-12-22T22:10:21.274 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: ftp.linux.ncsu.edu 2019-12-22T22:10:21.275 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: www.gtlib.gatech.edu 2019-12-22T22:10:21.276 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:10:24.302 INFO:teuthology.orchestra.run.smithi168.stdout:Resolving Dependencies 2019-12-22T22:10:24.303 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:10:24.303 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-22T22:10:25.559 INFO:teuthology.orchestra.run.smithi168.stdout:--> Finished Dependency Resolution 2019-12-22T22:10:26.426 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:10:26.426 INFO:teuthology.orchestra.run.smithi168.stdout:Dependencies Resolved 2019-12-22T22:10:26.435 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:10:26.435 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:10:26.435 INFO:teuthology.orchestra.run.smithi168.stdout: Package Arch Version Repository Size 2019-12-22T22:10:26.436 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:10:26.436 INFO:teuthology.orchestra.run.smithi168.stdout:Installing: 2019-12-22T22:10:26.436 INFO:teuthology.orchestra.run.smithi168.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-22T22:10:26.436 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:10:26.436 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction Summary 2019-12-22T22:10:26.436 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:10:26.437 INFO:teuthology.orchestra.run.smithi168.stdout:Install 1 Package 2019-12-22T22:10:26.437 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:10:26.437 INFO:teuthology.orchestra.run.smithi168.stdout:Total download size: 50 M 2019-12-22T22:10:26.437 INFO:teuthology.orchestra.run.smithi168.stdout:Installed size: 64 M 2019-12-22T22:10:26.437 INFO:teuthology.orchestra.run.smithi168.stdout:Downloading packages: 2019-12-22T22:10:26.440 INFO:teuthology.orchestra.run.smithi168.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-22T22:10:27.380 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction check 2019-12-22T22:10:27.571 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction test 2019-12-22T22:10:28.458 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction test succeeded 2019-12-22T22:10:28.458 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction 2019-12-22T22:11:03.038 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-22T22:11:03.594 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-22T22:11:03.594 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:11:03.594 INFO:teuthology.orchestra.run.smithi168.stdout:Installed: 2019-12-22T22:11:03.594 INFO:teuthology.orchestra.run.smithi168.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-22T22:11:03.594 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:11:03.594 INFO:teuthology.orchestra.run.smithi168.stdout:Complete! 2019-12-22T22:11:03.647 INFO:teuthology.orchestra.run.smithi168:> rpm -q kernel --last | head -n 1 2019-12-22T22:11:04.023 INFO:teuthology.orchestra.run.smithi168.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 22 Dec 2019 10:10:31 PM UTC 2019-12-22T22:11:04.025 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:11:04.025 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:11:04.025 INFO:teuthology.orchestra.run.smithi187:> uname -r 2019-12-22T22:11:04.140 INFO:teuthology.orchestra.run.smithi187.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-22T22:11:04.140 INFO:teuthology.task.kernel:Running kernel on smithi187: 3.10.0-1062.4.1.el7.x86_64 2019-12-22T22:11:04.141 INFO:teuthology.orchestra.run.smithi187:> sudo yum install -y kernel 2019-12-22T22:11:05.010 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:11:05.128 INFO:teuthology.orchestra.run.smithi187.stdout:Determining fastest mirrors 2019-12-22T22:11:05.758 INFO:teuthology.orchestra.run.smithi187.stdout: * base: mirror.umd.edu 2019-12-22T22:11:05.769 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: ftp.linux.ncsu.edu 2019-12-22T22:11:05.770 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:11:05.770 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:11:09.089 INFO:teuthology.orchestra.run.smithi187.stdout:Resolving Dependencies 2019-12-22T22:11:09.089 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:11:09.090 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-22T22:11:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:--> Finished Dependency Resolution 2019-12-22T22:11:11.269 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:11:11.269 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies Resolved 2019-12-22T22:11:11.270 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:11:11.271 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:11:11.271 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2019-12-22T22:11:11.271 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:11:11.271 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2019-12-22T22:11:11.271 INFO:teuthology.orchestra.run.smithi187.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-22T22:11:11.271 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:11:11.272 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2019-12-22T22:11:11.272 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:11:11.272 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2019-12-22T22:11:11.272 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:11:11.272 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 50 M 2019-12-22T22:11:11.273 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 64 M 2019-12-22T22:11:11.273 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading packages: 2019-12-22T22:11:11.276 INFO:teuthology.orchestra.run.smithi187.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-22T22:11:12.236 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2019-12-22T22:11:12.430 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2019-12-22T22:11:13.361 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded 2019-12-22T22:11:13.361 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2019-12-22T22:11:48.085 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-22T22:11:48.651 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-22T22:11:48.651 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:11:48.651 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2019-12-22T22:11:48.651 INFO:teuthology.orchestra.run.smithi187.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-22T22:11:48.652 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:11:48.652 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2019-12-22T22:11:48.709 INFO:teuthology.orchestra.run.smithi187:> rpm -q kernel --last | head -n 1 2019-12-22T22:11:49.121 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 22 Dec 2019 10:11:16 PM UTC 2019-12-22T22:11:49.124 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:11:49.124 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:11:49.124 INFO:teuthology.orchestra.run.smithi071:> uname -r 2019-12-22T22:11:49.250 INFO:teuthology.orchestra.run.smithi071.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-22T22:11:49.250 INFO:teuthology.task.kernel:Running kernel on smithi071: 3.10.0-1062.4.1.el7.x86_64 2019-12-22T22:11:49.250 INFO:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2019-12-22T22:11:50.211 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout:Determining fastest mirrors 2019-12-22T22:11:50.991 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.umd.edu 2019-12-22T22:11:51.002 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: ftp.linux.ncsu.edu 2019-12-22T22:11:51.003 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:11:51.003 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:11:54.507 INFO:teuthology.orchestra.run.smithi071.stdout:Resolving Dependencies 2019-12-22T22:11:54.508 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:11:54.508 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-22T22:11:55.903 INFO:teuthology.orchestra.run.smithi071.stdout:--> Finished Dependency Resolution 2019-12-22T22:11:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:11:56.863 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies Resolved 2019-12-22T22:11:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:11:56.866 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:11:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2019-12-22T22:11:56.866 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:11:56.866 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2019-12-22T22:11:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-22T22:11:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:11:56.867 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2019-12-22T22:11:56.867 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:11:56.867 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2019-12-22T22:11:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:11:56.867 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 50 M 2019-12-22T22:11:56.867 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 64 M 2019-12-22T22:11:56.867 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading packages: 2019-12-22T22:11:56.877 INFO:teuthology.orchestra.run.smithi071.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-22T22:11:57.933 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2019-12-22T22:11:58.124 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2019-12-22T22:11:58.971 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded 2019-12-22T22:11:58.972 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2019-12-22T22:12:33.668 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-22T22:12:34.182 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-22T22:12:34.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:12:34.182 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2019-12-22T22:12:34.182 INFO:teuthology.orchestra.run.smithi071.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-22T22:12:34.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:12:34.182 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2019-12-22T22:12:34.231 INFO:teuthology.orchestra.run.smithi071:> rpm -q kernel --last | head -n 1 2019-12-22T22:12:34.556 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 22 Dec 2019 10:12:01 PM UTC 2019-12-22T22:12:34.558 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:34.558 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:34.558 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-12-22T22:12:34.558 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-22T22:12:34.559 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-22T22:12:34.559 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-22T22:12:34.559 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-12-22T22:12:34.559 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2019-12-22T22:12:34.559 INFO:teuthology.orchestra.run.smithi071:> rpm -q kernel --last | head -n 1 2019-12-22T22:12:34.903 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 22 Dec 2019 10:12:01 PM UTC 2019-12-22T22:12:34.905 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:34.905 INFO:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2019-12-22T22:12:35.033 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2019-12-22T22:12:35.034 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2019-12-22T22:12:35.034 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.02 2019-12-22T22:12:35.034 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 0.76.el7.centos 2019-12-22T22:12:35.034 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2019-12-22T22:12:35.034 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Tue 05 Nov 2019 03:40:24 PM UTC 2019-12-22T22:12:35.034 INFO:teuthology.orchestra.run.smithi071.stdout:Group : System Environment/Base 2019-12-22T22:12:35.034 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 10080361 2019-12-22T22:12:35.035 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2019-12-22T22:12:35.035 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-22T22:12:35.035 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-22T22:12:35.035 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-22T22:12:35.035 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-22T22:12:35.035 INFO:teuthology.orchestra.run.smithi071.stdout:Relocations : (not relocatable) 2019-12-22T22:12:35.035 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : CentOS BuildSystem 2019-12-22T22:12:35.036 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2019-12-22T22:12:35.036 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-22T22:12:35.036 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2019-12-22T22:12:35.036 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2019-12-22T22:12:35.036 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:12:35.036 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-22T22:12:35.036 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-22T22:12:35.037 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-22T22:12:35.037 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2019-12-22T22:12:35.037 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:12:35.037 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2019-12-22T22:12:35.038 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-22T22:12:35.038 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:35.038 INFO:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-22T22:12:35.709 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2019-12-22T22:12:35.877 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:35.893 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-22T22:12:36.170 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-22T22:12:36.198 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-22T22:12:36.236 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-22T22:12:36.257 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-22T22:12:36.285 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-22T22:12:36.294 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-22T22:12:37.249 INFO:teuthology.orchestra.run.smithi071.stderr:done 2019-12-22T22:12:37.250 INFO:teuthology.orchestra.run.smithi071:> mktemp 2019-12-22T22:12:37.313 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.sOq80l4B2P 2019-12-22T22:12:37.314 INFO:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sOq80l4B2P 2019-12-22T22:12:37.383 INFO:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.sOq80l4B2P 2019-12-22T22:12:37.513 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.sOq80l4B2P is 6KB 2019-12-22T22:12:37.569 INFO:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.sOq80l4B2P 2019-12-22T22:12:37.614 INFO:teuthology.orchestra.run.smithi071:> sudo grub2-set-default 0 2019-12-22T22:12:37.824 INFO:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2019-12-22T22:12:37.827 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2019-12-22T22:12:37.827 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi168.front.sepia.ceph.com, path=None, version=distro) 2019-12-22T22:12:37.828 INFO:teuthology.orchestra.run.smithi168:> rpm -q kernel --last | head -n 1 2019-12-22T22:12:38.194 INFO:teuthology.orchestra.run.smithi168.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 22 Dec 2019 10:10:31 PM UTC 2019-12-22T22:12:38.196 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:38.197 INFO:teuthology.orchestra.run.smithi168:> sudo rpm -qi grub2-tools 2019-12-22T22:12:38.325 INFO:teuthology.orchestra.run.smithi168.stdout:Name : grub2-tools 2019-12-22T22:12:38.325 INFO:teuthology.orchestra.run.smithi168.stdout:Epoch : 1 2019-12-22T22:12:38.325 INFO:teuthology.orchestra.run.smithi168.stdout:Version : 2.02 2019-12-22T22:12:38.325 INFO:teuthology.orchestra.run.smithi168.stdout:Release : 0.76.el7.centos 2019-12-22T22:12:38.327 INFO:teuthology.orchestra.run.smithi168.stdout:Architecture: x86_64 2019-12-22T22:12:38.327 INFO:teuthology.orchestra.run.smithi168.stdout:Install Date: Tue 05 Nov 2019 03:40:24 PM UTC 2019-12-22T22:12:38.327 INFO:teuthology.orchestra.run.smithi168.stdout:Group : System Environment/Base 2019-12-22T22:12:38.328 INFO:teuthology.orchestra.run.smithi168.stdout:Size : 10080361 2019-12-22T22:12:38.328 INFO:teuthology.orchestra.run.smithi168.stdout:License : GPLv3+ 2019-12-22T22:12:38.328 INFO:teuthology.orchestra.run.smithi168.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-22T22:12:38.328 INFO:teuthology.orchestra.run.smithi168.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-22T22:12:38.328 INFO:teuthology.orchestra.run.smithi168.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-22T22:12:38.329 INFO:teuthology.orchestra.run.smithi168.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-22T22:12:38.329 INFO:teuthology.orchestra.run.smithi168.stdout:Relocations : (not relocatable) 2019-12-22T22:12:38.329 INFO:teuthology.orchestra.run.smithi168.stdout:Packager : CentOS BuildSystem 2019-12-22T22:12:38.329 INFO:teuthology.orchestra.run.smithi168.stdout:Vendor : CentOS 2019-12-22T22:12:38.329 INFO:teuthology.orchestra.run.smithi168.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-22T22:12:38.330 INFO:teuthology.orchestra.run.smithi168.stdout:Summary : Support tools for GRUB. 2019-12-22T22:12:38.330 INFO:teuthology.orchestra.run.smithi168.stdout:Description : 2019-12-22T22:12:38.330 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:12:38.330 INFO:teuthology.orchestra.run.smithi168.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-22T22:12:38.330 INFO:teuthology.orchestra.run.smithi168.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-22T22:12:38.330 INFO:teuthology.orchestra.run.smithi168.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-22T22:12:38.331 INFO:teuthology.orchestra.run.smithi168.stdout:hardware devices. 2019-12-22T22:12:38.331 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:12:38.331 INFO:teuthology.orchestra.run.smithi168.stdout:This subpackage provides tools for support of all platforms. 2019-12-22T22:12:38.333 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-22T22:12:38.333 INFO:teuthology.task.kernel:Updating grub on smithi168 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:38.333 INFO:teuthology.orchestra.run.smithi168:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-22T22:12:38.777 INFO:teuthology.orchestra.run.smithi168.stderr:Generating grub configuration file ... 2019-12-22T22:12:38.913 INFO:teuthology.orchestra.run.smithi168.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:38.926 INFO:teuthology.orchestra.run.smithi168.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-22T22:12:39.148 INFO:teuthology.orchestra.run.smithi168.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-22T22:12:39.174 INFO:teuthology.orchestra.run.smithi168.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-22T22:12:39.203 INFO:teuthology.orchestra.run.smithi168.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-22T22:12:39.219 INFO:teuthology.orchestra.run.smithi168.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-22T22:12:39.244 INFO:teuthology.orchestra.run.smithi168.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-22T22:12:39.251 INFO:teuthology.orchestra.run.smithi168.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-22T22:12:40.429 INFO:teuthology.orchestra.run.smithi168.stderr:done 2019-12-22T22:12:40.431 INFO:teuthology.orchestra.run.smithi168:> mktemp 2019-12-22T22:12:40.498 INFO:teuthology.orchestra.run.smithi168.stdout:/tmp/tmp.zYhABiF9LS 2019-12-22T22:12:40.498 INFO:teuthology.orchestra.run.smithi168:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zYhABiF9LS 2019-12-22T22:12:40.569 INFO:teuthology.orchestra.run.smithi168:> sudo chmod 0666 /tmp/tmp.zYhABiF9LS 2019-12-22T22:12:40.815 DEBUG:teuthology.orchestra.remote:smithi168:/tmp/tmp.zYhABiF9LS is 6KB 2019-12-22T22:12:40.911 INFO:teuthology.orchestra.run.smithi168:> rm -fr /tmp/tmp.zYhABiF9LS 2019-12-22T22:12:40.986 INFO:teuthology.orchestra.run.smithi168:> sudo grub2-set-default 0 2019-12-22T22:12:41.229 INFO:teuthology.orchestra.run.smithi168:> sudo shutdown -r now 2019-12-22T22:12:41.237 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-12-22T22:12:41.237 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro) 2019-12-22T22:12:41.237 INFO:teuthology.orchestra.run.smithi187:> rpm -q kernel --last | head -n 1 2019-12-22T22:12:41.604 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 22 Dec 2019 10:11:16 PM UTC 2019-12-22T22:12:41.606 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:41.606 INFO:teuthology.orchestra.run.smithi187:> sudo rpm -qi grub2-tools 2019-12-22T22:12:41.783 INFO:teuthology.orchestra.run.smithi187.stdout:Name : grub2-tools 2019-12-22T22:12:41.783 INFO:teuthology.orchestra.run.smithi187.stdout:Epoch : 1 2019-12-22T22:12:41.783 INFO:teuthology.orchestra.run.smithi187.stdout:Version : 2.02 2019-12-22T22:12:41.783 INFO:teuthology.orchestra.run.smithi187.stdout:Release : 0.76.el7.centos 2019-12-22T22:12:41.783 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: x86_64 2019-12-22T22:12:41.784 INFO:teuthology.orchestra.run.smithi187.stdout:Install Date: Tue 05 Nov 2019 03:40:24 PM UTC 2019-12-22T22:12:41.784 INFO:teuthology.orchestra.run.smithi187.stdout:Group : System Environment/Base 2019-12-22T22:12:41.784 INFO:teuthology.orchestra.run.smithi187.stdout:Size : 10080361 2019-12-22T22:12:41.784 INFO:teuthology.orchestra.run.smithi187.stdout:License : GPLv3+ 2019-12-22T22:12:41.784 INFO:teuthology.orchestra.run.smithi187.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-22T22:12:41.784 INFO:teuthology.orchestra.run.smithi187.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-22T22:12:41.784 INFO:teuthology.orchestra.run.smithi187.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-22T22:12:41.785 INFO:teuthology.orchestra.run.smithi187.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-22T22:12:41.785 INFO:teuthology.orchestra.run.smithi187.stdout:Relocations : (not relocatable) 2019-12-22T22:12:41.785 INFO:teuthology.orchestra.run.smithi187.stdout:Packager : CentOS BuildSystem 2019-12-22T22:12:41.785 INFO:teuthology.orchestra.run.smithi187.stdout:Vendor : CentOS 2019-12-22T22:12:41.785 INFO:teuthology.orchestra.run.smithi187.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-22T22:12:41.785 INFO:teuthology.orchestra.run.smithi187.stdout:Summary : Support tools for GRUB. 2019-12-22T22:12:41.786 INFO:teuthology.orchestra.run.smithi187.stdout:Description : 2019-12-22T22:12:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:12:41.786 INFO:teuthology.orchestra.run.smithi187.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-22T22:12:41.786 INFO:teuthology.orchestra.run.smithi187.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-22T22:12:41.786 INFO:teuthology.orchestra.run.smithi187.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-22T22:12:41.786 INFO:teuthology.orchestra.run.smithi187.stdout:hardware devices. 2019-12-22T22:12:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:12:41.787 INFO:teuthology.orchestra.run.smithi187.stdout:This subpackage provides tools for support of all platforms. 2019-12-22T22:12:41.790 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-22T22:12:41.791 INFO:teuthology.task.kernel:Updating grub on smithi187 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:41.791 INFO:teuthology.orchestra.run.smithi187:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-22T22:12:42.278 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2019-12-22T22:12:42.426 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:12:42.442 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-22T22:12:42.738 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-22T22:12:42.775 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-22T22:12:42.808 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-22T22:12:42.829 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-22T22:12:42.861 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-22T22:12:42.872 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-22T22:12:43.945 INFO:teuthology.orchestra.run.smithi187.stderr:done 2019-12-22T22:12:43.952 INFO:teuthology.orchestra.run.smithi187:> mktemp 2019-12-22T22:12:44.042 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.f8gO0JdQW9 2019-12-22T22:12:44.043 INFO:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.f8gO0JdQW9 2019-12-22T22:12:44.208 INFO:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.f8gO0JdQW9 2019-12-22T22:12:44.385 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.f8gO0JdQW9 is 6KB 2019-12-22T22:12:44.462 INFO:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.f8gO0JdQW9 2019-12-22T22:12:44.533 INFO:teuthology.orchestra.run.smithi187:> sudo grub2-set-default 0 2019-12-22T22:12:44.753 INFO:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2019-12-22T22:12:44.757 INFO:teuthology.misc:Re-opening connections... 2019-12-22T22:12:44.757 INFO:teuthology.misc:trying to connect to ubuntu@smithi168.front.sepia.ceph.com 2019-12-22T22:12:44.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:12:44.758 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:13:19.424 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.168 2019-12-22T22:13:19.511 INFO:teuthology.misc:trying to connect to ubuntu@smithi071.front.sepia.ceph.com 2019-12-22T22:13:19.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:13:19.512 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:13:37.848 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2019-12-22T22:13:37.849 INFO:teuthology.misc:trying to connect to ubuntu@smithi187.front.sepia.ceph.com 2019-12-22T22:13:37.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:13:37.849 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:12.408 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2019-12-22T22:14:12.410 DEBUG:teuthology.misc:waited 87.6527359486 2019-12-22T22:14:13.416 INFO:teuthology.misc:trying to connect to ubuntu@smithi168.front.sepia.ceph.com 2019-12-22T22:14:13.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:13.417 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:16.472 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.168 2019-12-22T22:14:16.473 INFO:teuthology.misc:trying to connect to ubuntu@smithi071.front.sepia.ceph.com 2019-12-22T22:14:16.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:16.473 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:19.544 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2019-12-22T22:14:19.545 INFO:teuthology.misc:trying to connect to ubuntu@smithi187.front.sepia.ceph.com 2019-12-22T22:14:19.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:19.546 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:22.527 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2019-12-22T22:14:22.527 DEBUG:teuthology.misc:waited 97.7706179619 2019-12-22T22:14:23.528 INFO:teuthology.misc:trying to connect to ubuntu@smithi168.front.sepia.ceph.com 2019-12-22T22:14:23.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:23.529 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:23.999 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.168 2019-12-22T22:14:23.999 INFO:teuthology.misc:trying to connect to ubuntu@smithi071.front.sepia.ceph.com 2019-12-22T22:14:23.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:23.999 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:26.219 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2019-12-22T22:14:26.220 INFO:teuthology.misc:trying to connect to ubuntu@smithi187.front.sepia.ceph.com 2019-12-22T22:14:26.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:26.220 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:26.323 INFO:teuthology.orchestra.run.smithi187:> true 2019-12-22T22:14:26.682 DEBUG:teuthology.misc:waited 101.924947023 2019-12-22T22:14:27.684 INFO:teuthology.misc:trying to connect to ubuntu@smithi168.front.sepia.ceph.com 2019-12-22T22:14:27.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:27.685 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:27.693 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.168 2019-12-22T22:14:27.693 INFO:teuthology.misc:trying to connect to ubuntu@smithi071.front.sepia.ceph.com 2019-12-22T22:14:27.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:27.694 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:28.696 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2019-12-22T22:14:28.697 DEBUG:teuthology.misc:waited 103.939888 2019-12-22T22:14:29.698 INFO:teuthology.misc:trying to connect to ubuntu@smithi168.front.sepia.ceph.com 2019-12-22T22:14:29.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:29.698 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:29.775 INFO:teuthology.orchestra.run.smithi168:> true 2019-12-22T22:14:30.089 DEBUG:teuthology.misc:waited 105.332052946 2019-12-22T22:14:31.090 INFO:teuthology.misc:trying to connect to ubuntu@smithi071.front.sepia.ceph.com 2019-12-22T22:14:31.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:31.090 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:31.092 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2019-12-22T22:14:31.092 DEBUG:teuthology.misc:waited 106.334939003 2019-12-22T22:14:32.093 INFO:teuthology.misc:trying to connect to ubuntu@smithi071.front.sepia.ceph.com 2019-12-22T22:14:32.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:14:32.093 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:14:32.182 INFO:teuthology.orchestra.run.smithi071:> true 2019-12-22T22:14:32.476 DEBUG:teuthology.misc:waited 107.718828917 2019-12-22T22:14:33.476 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-12-22T22:14:33.476 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-22T22:14:33.477 INFO:teuthology.orchestra.run.smithi071:> uname -r 2019-12-22T22:14:33.566 INFO:teuthology.orchestra.run.smithi071.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:14:33.566 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 vs 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:14:33.567 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-22T22:14:33.567 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2019-12-22T22:14:33.567 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-22T22:14:33.567 INFO:teuthology.orchestra.run.smithi168:> uname -r 2019-12-22T22:14:33.631 INFO:teuthology.orchestra.run.smithi168.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:14:33.631 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 vs 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:14:33.631 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-22T22:14:33.631 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-12-22T22:14:33.631 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-22T22:14:33.632 INFO:teuthology.orchestra.run.smithi187:> uname -r 2019-12-22T22:14:33.720 INFO:teuthology.orchestra.run.smithi187.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:14:33.721 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 vs 3.10.0-1062.9.1.el7.x86_64 2019-12-22T22:14:33.721 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-22T22:14:34.722 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-12-22T22:14:34.722 INFO:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-22T22:14:34.840 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2019-12-22T22:14:34.854 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2019-12-22T22:14:34.854 INFO:teuthology.orchestra.run.smithi168:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-22T22:14:34.923 INFO:teuthology.orchestra.run.smithi168.stdout:ttyS1 2019-12-22T22:14:34.937 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-12-22T22:14:34.938 INFO:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-22T22:14:35.059 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2019-12-22T22:14:35.071 INFO:teuthology.run_tasks:Running task internal.base... 2019-12-22T22:14:35.080 INFO:teuthology.task.internal:Creating test directory... 2019-12-22T22:14:35.081 INFO:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-22T22:14:35.086 INFO:teuthology.orchestra.run.smithi168:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-22T22:14:35.089 INFO:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-22T22:14:35.161 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-12-22T22:14:35.187 INFO:teuthology.run_tasks:Running task internal.archive... 2019-12-22T22:14:35.224 INFO:teuthology.task.internal:Creating archive directory... 2019-12-22T22:14:35.224 INFO:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-22T22:14:35.241 INFO:teuthology.orchestra.run.smithi168:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-22T22:14:35.257 INFO:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-22T22:14:35.336 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-12-22T22:14:35.367 INFO:teuthology.task.internal:Enabling coredump saving... 2019-12-22T22:14:35.367 INFO:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-22T22:14:35.376 INFO:teuthology.orchestra.run.smithi168:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-22T22:14:35.380 INFO:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-22T22:14:35.431 INFO:teuthology.orchestra.run.smithi168.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-22T22:14:35.439 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-22T22:14:35.468 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-22T22:14:35.471 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-12-22T22:14:35.513 INFO:teuthology.task.internal:Configuring sudo... 2019-12-22T22:14:35.513 INFO:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-22T22:14:35.517 INFO:teuthology.orchestra.run.smithi168:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-22T22:14:35.519 INFO:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-22T22:14:35.597 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-12-22T22:14:35.628 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-12-22T22:14:35.628 INFO:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-22T22:14:35.631 INFO:teuthology.orchestra.run.smithi168:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-22T22:14:35.635 INFO:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-22T22:14:35.688 INFO:teuthology.orchestra.run.smithi168:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-22T22:14:35.768 INFO:teuthology.orchestra.run.smithi168:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-22T22:14:35.852 INFO:teuthology.orchestra.run.smithi168:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-22T22:14:35.910 INFO:teuthology.orchestra.run.smithi168:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-22T22:14:35.991 INFO:teuthology.orchestra.run.smithi168:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-22T22:14:36.046 INFO:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-22T22:14:36.103 INFO:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-22T22:14:36.191 INFO:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-22T22:14:36.251 INFO:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-22T22:14:36.303 INFO:teuthology.orchestra.run.smithi071:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-22T22:14:36.362 INFO:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-22T22:14:36.430 INFO:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-22T22:14:36.491 INFO:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-22T22:14:36.548 INFO:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-22T22:14:36.625 INFO:teuthology.orchestra.run.smithi187:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-22T22:14:36.681 INFO:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2019-12-22T22:14:36.686 INFO:teuthology.orchestra.run.smithi168:> sudo service rsyslog restart 2019-12-22T22:14:36.689 INFO:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2019-12-22T22:14:36.746 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-22T22:14:36.775 INFO:teuthology.orchestra.run.smithi168.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-22T22:14:36.793 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-22T22:14:36.811 INFO:teuthology.run_tasks:Running task internal.timer... 2019-12-22T22:14:36.865 INFO:teuthology.task.internal:Starting timer... 2019-12-22T22:14:36.866 INFO:teuthology.run_tasks:Running task pcp... 2019-12-22T22:14:36.962 INFO:teuthology.run_tasks:Running task selinux... 2019-12-22T22:14:36.976 INFO:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2019-12-22T22:14:37.061 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: [ OK ] 2019-12-22T22:14:37.062 INFO:teuthology.orchestra.run.smithi168:> sudo service auditd rotate 2019-12-22T22:14:37.154 INFO:teuthology.orchestra.run.smithi168.stdout:Rotating logs: [ OK ] 2019-12-22T22:14:37.155 INFO:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2019-12-22T22:14:37.281 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: [ OK ] 2019-12-22T22:14:37.283 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-12-22T22:14:37.284 INFO:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2019-12-22T22:14:37.349 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2019-12-22T22:14:37.349 INFO:teuthology.orchestra.run.smithi168:> /usr/sbin/getenforce 2019-12-22T22:14:37.442 INFO:teuthology.orchestra.run.smithi168.stdout:Permissive 2019-12-22T22:14:37.443 INFO:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2019-12-22T22:14:37.490 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2019-12-22T22:14:37.491 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi168.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive'} 2019-12-22T22:14:37.491 INFO:teuthology.orchestra.run.smithi187:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-22T22:14:37.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-22T22:14:37.586 INFO:teuthology.orchestra.run.smithi168:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-22T22:14:37.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-22T22:14:37.674 INFO:teuthology.orchestra.run.smithi071:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-22T22:14:37.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-22T22:14:37.727 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-12-22T22:14:37.727 INFO:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2019-12-22T22:14:37.851 INFO:teuthology.orchestra.run.smithi168:> sudo /usr/sbin/setenforce permissive 2019-12-22T22:14:37.971 INFO:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2019-12-22T22:14:38.035 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-12-22T22:14:38.049 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2019-12-22T22:14:38.049 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-12-22T22:14:38.204 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-12-22T22:14:38.209 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi168.front.sepia.ceph.com,smithi071.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-12-22T22:14:38.774 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-12-22T22:14:40.596 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2019-12-22T22:14:43.616 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-12-22T22:14:43.657 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:43 +0000 (0:00:00.154) 0:00:00.154 ******* 2019-12-22T22:14:43.670 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:43 +0000 (0:00:00.013) 0:00:00.167 ******* 2019-12-22T22:14:43.683 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:43 +0000 (0:00:00.012) 0:00:00.179 ******* 2019-12-22T22:14:46.940 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-12-22T22:14:46.948 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] 2019-12-22T22:14:46.961 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] 2019-12-22T22:14:47.045 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] 2019-12-22T22:14:47.047 INFO:teuthology.task.ansible.out: 2019-12-22T22:14:47.096 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:47 +0000 (0:00:03.413) 0:00:03.592 ******* 2019-12-22T22:14:47.156 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:47 +0000 (0:00:00.059) 0:00:03.653 ******* 2019-12-22T22:14:47.198 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:47 +0000 (0:00:00.041) 0:00:03.695 ******* 2019-12-22T22:14:47.585 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-22T22:14:47.587 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-22T22:14:47.625 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:47 +0000 (0:00:00.427) 0:00:04.122 ******* 2019-12-22T22:14:47.631 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-22T22:14:47.632 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-22T22:14:47.669 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:47 +0000 (0:00:00.043) 0:00:04.166 ******* 2019-12-22T22:14:47.703 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:47 +0000 (0:00:00.034) 0:00:04.200 ******* 2019-12-22T22:14:48.189 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-22T22:14:48.191 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-22T22:14:48.237 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:48 +0000 (0:00:00.533) 0:00:04.734 ******* 2019-12-22T22:14:48.244 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-22T22:14:48.246 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-22T22:14:48.284 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:48 +0000 (0:00:00.046) 0:00:04.780 ******* 2019-12-22T22:14:48.331 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:48 +0000 (0:00:00.045) 0:00:04.826 ******* 2019-12-22T22:14:48.336 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-12-22T22:14:48.338 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:48.376 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:48 +0000 (0:00:00.046) 0:00:04.873 ******* 2019-12-22T22:14:48.407 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:48 +0000 (0:00:00.031) 0:00:04.904 ******* 2019-12-22T22:14:48.413 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:48.452 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:48 +0000 (0:00:00.044) 0:00:04.949 ******* 2019-12-22T22:14:48.806 INFO:teuthology.task.ansible.out: 2019-12-22T22:14:48.806 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-12-22T22:14:48.808 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:14:48.812 INFO:teuthology.task.ansible.out: 2019-12-22T22:14:48.815 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:14:48.816 INFO:teuthology.task.ansible.out: 2019-12-22T22:14:48.884 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:48 +0000 (0:00:00.431) 0:00:05.381 ******* 2019-12-22T22:14:48.917 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:48 +0000 (0:00:00.033) 0:00:05.414 ******* 2019-12-22T22:14:48.922 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:14:48.965 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:48 +0000 (0:00:00.047) 0:00:05.461 ******* 2019-12-22T22:14:50.442 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-12-22T22:14:50.443 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577052888.98-140156378967071/source", "state": "file", "uid": 0} 2019-12-22T22:14:50.482 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:50 +0000 (0:00:01.517) 0:00:06.978 ******* 2019-12-22T22:14:50.488 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577052888.93-64401973056832/source", "state": "file", "uid": 0} 2019-12-22T22:14:50.490 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577052888.9-79760767099520/source", "state": "file", "uid": 0} 2019-12-22T22:14:50.538 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:50 +0000 (0:00:00.055) 0:00:07.034 ******* 2019-12-22T22:14:50.571 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:50 +0000 (0:00:00.033) 0:00:07.067 ******* 2019-12-22T22:14:51.122 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-12-22T22:14:51.123 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:51.124 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:51.166 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:51.454 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:51.471 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi187.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => 2019-12-22T22:14:51.473 INFO:teuthology.task.ansible.out:{"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:51.768 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:51.780 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:51.803 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:52.086 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:52.122 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:52.144 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:52.413 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:52.436 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:52.456 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:52.705 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:52.782 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:52.783 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:53.066 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:53.112 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:53.180 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-22T22:14:53.305 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-12-22T22:14:53.312 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-12-22T22:14:53.537 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:53 +0000 (0:00:02.966) 0:00:10.034 ******* 2019-12-22T22:14:53.576 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:53 +0000 (0:00:00.033) 0:00:10.068 ******* 2019-12-22T22:14:53.603 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:53 +0000 (0:00:00.031) 0:00:10.099 ******* 2019-12-22T22:14:54.421 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-12-22T22:14:54.421 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] 2019-12-22T22:14:54.473 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] 2019-12-22T22:14:54.519 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-12-22T22:14:54.521 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:54 +0000 (0:00:00.916) 0:00:11.016 ******* 2019-12-22T22:14:54.605 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:54 +0000 (0:00:00.085) 0:00:11.102 ******* 2019-12-22T22:14:55.056 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-12-22T22:14:55.057 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.228496", "end": "2019-12-22 22:14:55.022454", "rc": 0, "start": "2019-12-22 22:14:54.793958", "stderr": "", "stderr_lines": [], "stdout": "f4e10beea550ddcc5081090533acfa405cd36c43", "stdout_lines": ["f4e10beea550ddcc5081090533acfa405cd36c43"]} 2019-12-22T22:14:55.114 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.508) 0:00:11.610 ******* 2019-12-22T22:14:55.123 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.276785", "end": "2019-12-22 22:14:55.090691", "rc": 0, "start": "2019-12-22 22:14:54.813906", "stderr": "", "stderr_lines": [], "stdout": "f4e10beea550ddcc5081090533acfa405cd36c43", "stdout_lines": ["f4e10beea550ddcc5081090533acfa405cd36c43"]} 2019-12-22T22:14:55.162 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.048) 0:00:11.659 ******* 2019-12-22T22:14:55.412 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-12-22T22:14:55.413 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011289", "end": "2019-12-22 22:14:55.381378", "failed_when_result": false, "rc": 0, "start": "2019-12-22 22:14:55.370089", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-22T22:14:55.455 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.292) 0:00:11.952 ******* 2019-12-22T22:14:55.464 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010444", "end": "2019-12-22 22:14:55.445057", "failed_when_result": false, "rc": 0, "start": "2019-12-22 22:14:55.434613", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-22T22:14:55.505 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.049) 0:00:12.002 ******* 2019-12-22T22:14:55.511 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-22T22:14:55.512 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:55.565 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.059) 0:00:12.062 ******* 2019-12-22T22:14:55.571 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:55.577 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-12-22T22:14:55.579 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] 2019-12-22T22:14:55.623 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.057) 0:00:12.119 ******* 2019-12-22T22:14:55.662 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-22T22:14:55.663 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:55.697 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.074) 0:00:12.194 ******* 2019-12-22T22:14:55.730 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.032) 0:00:12.227 ******* 2019-12-22T22:14:55.768 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.037) 0:00:12.265 ******* 2019-12-22T22:14:55.773 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-22T22:14:55.775 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:55.813 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.045) 0:00:12.310 ******* 2019-12-22T22:14:55.862 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.048) 0:00:12.359 ******* 2019-12-22T22:14:55.868 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-22T22:14:55.872 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:55.911 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.049) 0:00:12.408 ******* 2019-12-22T22:14:55.917 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:55.963 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:55 +0000 (0:00:00.051) 0:00:12.460 ******* 2019-12-22T22:14:55.969 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-22T22:14:55.970 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:56.008 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.044) 0:00:12.505 ******* 2019-12-22T22:14:56.014 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:56.054 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.046) 0:00:12.551 ******* 2019-12-22T22:14:56.176 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-12-22T22:14:56.178 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.214828", "end": "2019-12-22 22:14:56.143015", "rc": 0, "start": "2019-12-22 22:14:55.928187", "stderr": "", "stderr_lines": [], "stdout": "f4e10beea550ddcc5081090533acfa405cd36c43", "stdout_lines": ["f4e10beea550ddcc5081090533acfa405cd36c43"]} 2019-12-22T22:14:56.214 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.160) 0:00:12.711 ******* 2019-12-22T22:14:56.313 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-12-22T22:14:56.314 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:14:56.350 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.135) 0:00:12.846 ******* 2019-12-22T22:14:56.389 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:14:56.427 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.077) 0:00:12.924 ******* 2019-12-22T22:14:56.520 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-12-22T22:14:56.521 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009103", "end": "2019-12-22 22:14:56.496395", "failed_when_result": false, "rc": 0, "start": "2019-12-22 22:14:56.487292", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-22T22:14:56.561 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.134) 0:00:13.058 ******* 2019-12-22T22:14:56.587 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-22T22:14:56.588 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:56.625 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.064) 0:00:13.122 ******* 2019-12-22T22:14:56.652 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-22T22:14:56.653 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:56.688 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.063) 0:00:13.185 ******* 2019-12-22T22:14:56.705 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-22T22:14:56.705 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-22T22:14:56.718 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:56.756 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.067) 0:00:13.253 ******* 2019-12-22T22:14:56.792 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-22T22:14:56.793 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:56.794 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-22T22:14:56.794 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-22T22:14:56.834 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.078) 0:00:13.331 ******* 2019-12-22T22:14:56.861 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-22T22:14:56.862 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:14:56.901 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:56 +0000 (0:00:00.066) 0:00:13.398 ******* 2019-12-22T22:14:57.030 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-22T22:14:57.032 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-22T22:14:57.148 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-22T22:14:57.191 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-12-22T22:14:57.192 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:14:57.243 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:14:57 +0000 (0:00:00.342) 0:00:13.740 ******* 2019-12-22T22:14:57.301 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-22T22:14:57.302 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-22T22:14:57.502 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-22T22:14:57.608 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-22T22:14:57.651 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-22T22:14:57.820 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-22T22:14:57.905 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-22T22:14:57.990 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-22T22:14:58.138 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-22T22:14:58.223 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-22T22:14:58.334 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-22T22:14:58.470 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-22T22:14:58.524 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-22T22:14:58.697 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-22T22:14:58.795 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-22T22:14:58.849 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-22T22:14:59.045 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-22T22:14:59.108 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-22T22:14:59.204 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-22T22:14:59.314 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-22T22:14:59.448 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-22T22:14:59.536 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-22T22:14:59.665 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-22T22:14:59.793 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-22T22:14:59.901 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-22T22:15:00.007 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-22T22:15:00.143 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-22T22:15:00.241 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-22T22:15:00.347 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-22T22:15:00.490 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-22T22:15:00.554 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-22T22:15:00.717 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-22T22:15:00.840 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-22T22:15:00.896 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-22T22:15:01.049 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-22T22:15:01.113 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-22T22:15:01.209 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-22T22:15:01.415 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-22T22:15:01.437 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-22T22:15:01.550 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-22T22:15:01.742 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-22T22:15:01.799 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-22T22:15:01.865 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-22T22:15:02.075 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-22T22:15:02.139 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-22T22:15:02.220 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-22T22:15:02.412 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-22T22:15:02.424 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-22T22:15:02.575 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-22T22:15:02.744 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-22T22:15:02.756 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-22T22:15:02.923 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-22T22:15:03.094 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-22T22:15:03.137 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-22T22:15:03.246 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-22T22:15:03.416 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-22T22:15:03.443 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-22T22:15:03.565 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-22T22:15:03.758 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-22T22:15:03.781 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-22T22:15:03.887 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-22T22:15:04.060 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-22T22:15:04.094 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-22T22:15:04.202 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-22T22:15:04.382 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-22T22:15:04.468 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-22T22:15:04.553 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-22T22:15:04.703 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-22T22:15:04.812 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-22T22:15:04.887 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-22T22:15:05.034 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-22T22:15:05.152 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-22T22:15:05.208 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-22T22:15:05.375 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-22T22:15:05.508 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-22T22:15:05.530 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-22T22:15:05.780 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-22T22:15:05.858 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-22T22:15:05.895 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-22T22:15:06.096 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-22T22:15:06.181 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-22T22:15:06.182 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-22T22:15:06.449 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-22T22:15:06.503 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-22T22:15:06.516 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-22T22:15:06.817 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-22T22:15:06.839 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-22T22:15:06.875 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-22T22:15:07.126 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-22T22:15:07.138 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-22T22:15:07.247 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-22T22:15:07.421 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-22T22:15:07.456 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-22T22:15:07.552 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-22T22:15:07.728 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-22T22:15:07.807 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-22T22:15:07.850 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-22T22:15:08.071 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-22T22:15:08.102 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-22T22:15:08.188 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-22T22:15:08.420 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-22T22:15:08.432 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-22T22:15:08.539 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-22T22:15:08.765 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-22T22:15:08.788 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-22T22:15:08.863 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-22T22:15:09.100 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-22T22:15:09.144 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-22T22:15:09.201 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-22T22:15:09.443 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-22T22:15:09.444 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-22T22:15:09.525 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-22T22:15:09.735 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-22T22:15:09.800 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-22T22:15:09.843 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-22T22:15:10.067 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-22T22:15:10.157 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-22T22:15:10.186 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-22T22:15:10.373 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-22T22:15:10.503 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-22T22:15:10.526 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-22T22:15:10.657 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-22T22:15:10.806 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-22T22:15:10.896 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-22T22:15:10.966 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-22T22:15:11.159 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-22T22:15:11.274 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-22T22:15:11.297 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-22T22:15:11.514 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-22T22:15:11.621 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-22T22:15:11.644 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-22T22:15:11.853 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-22T22:15:11.951 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-22T22:15:11.994 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-22T22:15:12.197 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-22T22:15:12.286 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-22T22:15:12.287 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-22T22:15:12.494 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-22T22:15:12.600 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-22T22:15:12.633 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-22T22:15:12.835 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-22T22:15:12.900 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-22T22:15:12.996 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-22T22:15:13.196 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-22T22:15:13.230 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-22T22:15:13.326 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-22T22:15:13.516 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-22T22:15:13.560 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-22T22:15:13.666 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-22T22:15:13.835 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-22T22:15:13.878 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-22T22:15:13.994 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-22T22:15:14.159 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-22T22:15:14.175 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-22T22:15:14.336 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-22T22:15:14.497 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-22T22:15:14.520 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-22T22:15:14.658 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-22T22:15:14.828 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-22T22:15:14.871 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-22T22:15:14.988 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-22T22:15:15.182 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-22T22:15:15.215 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-22T22:15:15.343 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-22T22:15:15.512 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-22T22:15:15.546 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-22T22:15:15.701 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-22T22:15:15.862 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-22T22:15:15.920 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-22T22:15:16.033 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-22T22:15:16.203 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-22T22:15:16.246 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-22T22:15:16.396 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-22T22:15:16.397 INFO:teuthology.task.ansible.out: 2019-12-22T22:15:16.520 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-22T22:15:16.598 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-22T22:15:16.726 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-22T22:15:16.888 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-22T22:15:16.935 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-22T22:15:17.059 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-22T22:15:17.218 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-22T22:15:17.293 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-22T22:15:17.389 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-22T22:15:17.547 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-22T22:15:17.653 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-22T22:15:17.750 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-22T22:15:17.879 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-22T22:15:17.963 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-22T22:15:18.092 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-22T22:15:18.197 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-22T22:15:18.292 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-22T22:15:18.407 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-22T22:15:18.524 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-22T22:15:18.619 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-22T22:15:18.749 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-22T22:15:18.857 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-22T22:15:18.973 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-22T22:15:19.116 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-22T22:15:19.194 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-22T22:15:19.289 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-22T22:15:19.428 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-22T22:15:19.532 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-22T22:15:19.619 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-22T22:15:19.781 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-22T22:15:19.879 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-22T22:15:19.969 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-22T22:15:20.059 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-22T22:15:20.207 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-22T22:15:20.282 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-22T22:15:20.409 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-22T22:15:20.536 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-22T22:15:20.568 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-22T22:15:20.739 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-22T22:15:20.866 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-22T22:15:20.888 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-22T22:15:21.100 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-22T22:15:21.230 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-22T22:15:21.263 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-22T22:15:21.443 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-22T22:15:21.528 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-22T22:15:21.576 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-22T22:15:21.752 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-22T22:15:21.871 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-22T22:15:21.912 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-22T22:15:22.126 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-22T22:15:22.213 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-22T22:15:22.288 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-22T22:15:22.480 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-22T22:15:22.568 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-22T22:15:22.633 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-22T22:15:22.850 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-22T22:15:22.904 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-22T22:15:22.969 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-22T22:15:23.201 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-22T22:15:23.213 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-22T22:15:23.284 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-22T22:15:23.523 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-22T22:15:23.535 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-22T22:15:23.601 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-22T22:15:23.846 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-22T22:15:23.878 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-22T22:15:23.925 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-22T22:15:24.177 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-22T22:15:24.220 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-22T22:15:24.221 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-22T22:15:24.529 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-22T22:15:24.572 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-22T22:15:24.590 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-22T22:15:24.857 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-22T22:15:24.900 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-22T22:15:24.912 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-22T22:15:25.168 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-22T22:15:25.231 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-22T22:15:25.253 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-22T22:15:25.497 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-22T22:15:25.603 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-22T22:15:25.631 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-22T22:15:25.823 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-22T22:15:25.929 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-22T22:15:25.993 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-22T22:15:26.181 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-22T22:15:26.266 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-22T22:15:26.330 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-22T22:15:26.521 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-22T22:15:26.595 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-22T22:15:26.670 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-22T22:15:26.850 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-22T22:15:26.924 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-22T22:15:27.183 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-22T22:15:27.259 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-22T22:15:27.552 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-22T22:15:27.586 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-22T22:15:27.888 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-22T22:15:27.911 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-22T22:15:28.007 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-22T22:15:28.217 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-22T22:15:28.270 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-22T22:15:28.356 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-22T22:15:28.547 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-22T22:15:28.601 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-22T22:15:28.694 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-22T22:15:28.873 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-22T22:15:28.937 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-22T22:15:29.021 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-22T22:15:29.199 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-22T22:15:29.297 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-22T22:15:29.371 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-22T22:15:29.539 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-22T22:15:29.623 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-22T22:15:29.708 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-22T22:15:29.898 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-22T22:15:29.982 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-22T22:15:30.026 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-22T22:15:30.216 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-22T22:15:30.274 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-22T22:15:30.368 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-22T22:15:30.547 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-22T22:15:30.705 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-22T22:15:30.848 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-22T22:15:31.006 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-22T22:15:31.028 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-22T22:15:31.198 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-22T22:15:31.382 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-22T22:15:31.557 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-22T22:15:31.726 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-22T22:15:31.897 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-22T22:15:32.014 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-22T22:15:32.221 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-22T22:15:32.286 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "name": "toabctl", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-12-22T22:15:32.559 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-22T22:15:32.602 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "name": "toabctl", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-12-22T22:15:32.875 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2019-12-22T22:15:32.960 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-22T22:15:32.998 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:32 +0000 (0:00:35.754) 0:00:49.495 ******* 2019-12-22T22:15:33.018 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-22T22:15:33.058 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:33 +0000 (0:00:00.060) 0:00:49.555 ******* 2019-12-22T22:15:33.107 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-22T22:15:33.111 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-22T22:15:33.112 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-22T22:15:33.115 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-22T22:15:33.117 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-22T22:15:33.118 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-22T22:15:33.120 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-22T22:15:33.121 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-22T22:15:33.122 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f 2019-12-22T22:15:33.123 INFO:teuthology.task.ansible.out:826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd1 2019-12-22T22:15:33.125 INFO:teuthology.task.ansible.out:7f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 2019-12-22T22:15:33.127 INFO:teuthology.task.ansible.out: 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn" 2019-12-22T22:15:33.129 INFO:teuthology.task.ansible.out:: "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}]}, "changed": false} 2019-12-22T22:15:33.167 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:33 +0000 (0:00:00.106) 0:00:49.661 ******* 2019-12-22T22:15:33.234 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-22T22:15:33.234 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2019-12-22T22:15:33.364 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-22T22:15:33.400 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:33 +0000 (0:00:00.235) 0:00:49.897 ******* 2019-12-22T22:15:33.420 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-22T22:15:33.457 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:33 +0000 (0:00:00.056) 0:00:49.953 ******* 2019-12-22T22:15:33.505 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-22T22:15:33.509 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-22T22:15:33.511 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-22T22:15:33.512 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-22T22:15:33.514 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-22T22:15:33.515 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJy 2019-12-22T22:15:33.515 INFO:teuthology.task.ansible.out:w 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-22T22:15:33.517 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-22T22:15:33.518 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f 2019-12-22T22:15:33.520 INFO:teuthology.task.ansible.out:826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd1 2019-12-22T22:15:33.521 INFO:teuthology.task.ansible.out:7f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a28 2019-12-22T22:15:33.521 INFO:teuthology.task.ansible.out:73481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 2019-12-22T22:15:33.523 INFO:teuthology.task.ansible.out: 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn" 2019-12-22T22:15:33.524 INFO:teuthology.task.ansible.out:: "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}]}, "changed": false} 2019-12-22T22:15:33.569 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:33 +0000 (0:00:00.111) 0:00:50.065 ******* 2019-12-22T22:15:33.607 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-22T22:15:33.607 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-22T22:15:34.238 INFO:teuthology.task.ansible.out:FAILED - RETRYING: Clone the keys repo (5 retries left). 2019-12-22T22:15:34.260 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-22T22:15:34.262 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com -> localhost] => {"after": "f4e10beea550ddcc5081090533acfa405cd36c43", "attempts": 1, "before": "f4e10beea550ddcc5081090533acfa405cd36c43", "changed": false, "remote_url_changed": false} 2019-12-22T22:15:34.308 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:34 +0000 (0:00:00.736) 0:00:50.801 ******* 2019-12-22T22:15:34.310 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-22T22:15:34.311 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-22T22:15:34.723 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:15:34.725 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-22T22:15:34.819 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-22T22:15:34.820 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "name": "toabctl", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-12-22T22:15:35.091 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:15:35.093 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-22T22:15:35.380 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-22T22:15:35.382 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2019-12-22T22:15:35.499 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:15:35.501 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-22T22:15:35.544 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:35 +0000 (0:00:01.240) 0:00:52.041 ******* 2019-12-22T22:15:35.567 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-22T22:15:35.605 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:35 +0000 (0:00:00.060) 0:00:52.101 ******* 2019-12-22T22:15:35.654 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-22T22:15:35.659 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-22T22:15:35.660 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-22T22:15:35.661 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-22T22:15:35.663 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-22T22:15:35.664 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-22T22:15:35.666 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-22T22:15:35.668 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-22T22:15:35.668 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f 2019-12-22T22:15:35.670 INFO:teuthology.task.ansible.out:826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd1 2019-12-22T22:15:35.671 INFO:teuthology.task.ansible.out:7f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 2019-12-22T22:15:35.673 INFO:teuthology.task.ansible.out: 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn" 2019-12-22T22:15:35.674 INFO:teuthology.task.ansible.out:: "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}]}, "changed": false} 2019-12-22T22:15:35.714 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:35 +0000 (0:00:00.109) 0:00:52.211 ******* 2019-12-22T22:15:35.752 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:15:35.755 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-22T22:15:36.081 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-22T22:15:36.083 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-22T22:15:36.398 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-22T22:15:36.399 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com -> localhost] => {"after": "f4e10beea550ddcc5081090533acfa405cd36c43", "attempts": 1, "before": "f4e10beea550ddcc5081090533acfa405cd36c43", "changed": false, "remote_url_changed": false} 2019-12-22T22:15:36.440 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:36 +0000 (0:00:00.726) 0:00:52.937 ******* 2019-12-22T22:15:36.446 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:15:36.447 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-22T22:15:36.776 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-22T22:15:36.778 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-22T22:15:36.861 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-22T22:15:37.143 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-22T22:15:37.197 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-22T22:15:37.496 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-22T22:15:37.510 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:37.553 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-22T22:15:37.840 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-22T22:15:37.842 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-22T22:15:37.851 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:37.862 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:37.874 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:37.875 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-22T22:15:38.210 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-22T22:15:38.223 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-22T22:15:38.224 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-22T22:15:38.558 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-22T22:15:38.560 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-22T22:15:38.570 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-22T22:15:38.889 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-22T22:15:38.932 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-22T22:15:38.933 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-22T22:15:39.221 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-22T22:15:39.285 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-22T22:15:39.540 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-22T22:15:39.634 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-22T22:15:39.656 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:39.874 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-22T22:15:39.992 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-22T22:15:39.994 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-22T22:15:40.004 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:40.015 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:40.036 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:40.196 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-22T22:15:40.374 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-22T22:15:40.533 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-22T22:15:40.881 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-22T22:15:40.883 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-22T22:15:40.904 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-22T22:15:40.905 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-22T22:15:41.238 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-22T22:15:41.242 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-22T22:15:41.247 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-22T22:15:41.568 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-22T22:15:41.620 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-22T22:15:41.896 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-22T22:15:41.981 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-22T22:15:42.213 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-22T22:15:42.215 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-22T22:15:42.343 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-22T22:15:42.543 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-22T22:15:42.691 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-22T22:15:42.872 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-22T22:15:43.030 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-22T22:15:43.247 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-22T22:15:43.399 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-22T22:15:43.400 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-22T22:15:43.738 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-22T22:15:43.740 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-22T22:15:43.750 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-22T22:15:44.090 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-22T22:15:44.112 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-22T22:15:44.473 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-22T22:15:44.475 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-22T22:15:44.485 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-22T22:15:44.866 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-22T22:15:44.868 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} TASK [users : Clone the keys repo] ********************************************* ok: [smithi071.front.sepia.ceph.com -> localhost] => {"after": "f4e10beea550ddcc5081090533acfa405cd36c43", "attempts": 2, "before": "f4e10beea550ddcc5081090533acfa405cd36c43", "changed": false, "remote_url_changed": false} 2019-12-22T22:15:44.940 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:15:44 +0000 (0:00:08.499) 0:01:01.436 ******* 2019-12-22T22:15:44.948 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:15:44.948 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-22T22:15:45.226 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-22T22:15:45.248 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-22T22:15:45.345 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-22T22:15:45.582 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-22T22:15:45.618 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-22T22:15:45.707 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-22T22:15:45.943 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-22T22:15:45.968 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-22T22:15:46.043 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-22T22:15:46.306 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-22T22:15:46.349 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-22T22:15:46.390 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-22T22:15:46.623 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-22T22:15:46.729 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-22T22:15:46.796 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c1931 2019-12-22T22:15:46.796 INFO:teuthology.task.ansible.out:69dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2019-12-22T22:15:46.798 INFO:teuthology.task.ansible.out: 2019-12-22T22:15:46.988 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-22T22:15:46.990 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-22T22:15:47.081 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-22T22:15:47.146 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-22T22:15:47.337 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-22T22:15:47.413 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-22T22:15:47.468 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-22T22:15:47.470 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-22T22:15:47.701 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-22T22:15:47.765 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-22T22:15:47.820 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-22T22:15:48.063 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-22T22:15:48.138 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+j 2019-12-22T22:15:48.139 INFO:teuthology.task.ansible.out:WDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-22T22:15:48.161 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-22T22:15:48.329 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:48.420 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-22T22:15:48.453 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-22T22:15:48.455 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-22T22:15:48.681 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-22T22:15:48.682 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-22T22:15:48.693 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:48.705 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:48.717 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:15:48.773 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-22T22:15:48.775 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-22T22:15:49.059 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-22T22:15:49.115 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHB 2019-12-22T22:15:49.116 INFO:teuthology.task.ansible.out:ImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-22T22:15:49.404 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-22T22:15:49.406 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-22T22:15:49.448 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-22T22:15:49.482 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-22T22:15:49.738 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-22T22:15:49.838 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-22T22:15:49.840 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-22T22:15:50.105 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-22T22:15:50.179 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-22T22:15:50.180 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-22T22:15:50.182 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-22T22:15:50.183 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-22T22:15:50.427 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-22T22:15:50.523 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-22T22:15:50.524 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-22T22:15:50.546 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-22T22:15:50.772 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-22T22:15:50.857 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-22T22:15:50.858 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-22T22:15:50.890 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-22T22:15:51.113 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-22T22:15:51.208 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-22T22:15:51.251 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-22T22:15:51.419 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-22T22:15:51.555 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-22T22:15:51.641 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-22T22:15:51.779 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-22T22:15:51.781 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-22T22:15:51.921 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-22T22:15:51.976 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-22T22:15:52.161 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-22T22:15:52.163 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-22T22:15:52.292 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-22T22:15:52.294 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-22T22:15:52.326 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-22T22:15:52.528 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-22T22:15:52.635 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-22T22:15:52.679 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-22T22:15:52.681 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-22T22:15:52.682 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-22T22:15:52.861 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-22T22:15:52.986 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-22T22:15:53.050 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-22T22:15:53.197 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-22T22:15:53.199 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-22T22:15:53.341 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-22T22:15:53.343 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-22T22:15:53.405 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-22T22:15:53.554 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-22T22:15:53.640 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-22T22:15:53.772 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-22T22:15:53.911 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-22T22:15:53.964 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-22T22:15:54.138 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-22T22:15:54.234 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-22T22:15:54.309 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-22T22:15:54.310 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-22T22:15:54.481 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-22T22:15:54.556 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-22T22:15:54.621 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-22T22:15:54.826 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1r 2019-12-22T22:15:54.828 INFO:teuthology.task.ansible.out:J7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-22T22:15:54.905 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-22T22:15:54.969 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-22T22:15:55.182 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-22T22:15:55.246 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-22T22:15:55.248 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-22T22:15:55.317 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-22T22:15:55.506 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-22T22:15:55.574 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-22T22:15:55.649 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-22T22:15:55.868 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-22T22:15:55.870 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-22T22:15:55.945 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-22T22:15:56.020 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-22T22:15:56.240 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-22T22:15:56.314 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-22T22:15:56.378 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-22T22:15:56.595 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-22T22:15:56.639 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-22T22:15:56.724 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-22T22:15:56.967 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-22T22:15:56.969 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-22T22:15:56.971 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-22T22:15:57.079 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-22T22:15:57.315 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-22T22:15:57.327 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-22T22:15:57.415 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-22T22:15:57.645 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-22T22:15:57.688 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-22T22:15:57.763 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-22T22:15:58.006 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-22T22:15:58.049 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-22T22:15:58.098 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-22T22:15:58.352 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-22T22:15:58.393 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdP 2019-12-22T22:15:58.394 INFO:teuthology.task.ansible.out:Buld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-22T22:15:58.439 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-22T22:15:58.703 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-22T22:15:58.704 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-22T22:15:58.746 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-22T22:15:58.789 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-22T22:15:59.032 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-22T22:15:59.034 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-22T22:15:59.107 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-22T22:15:59.119 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-22T22:15:59.375 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-22T22:15:59.460 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-22T22:15:59.494 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-22T22:15:59.746 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-22T22:15:59.836 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4q 2019-12-22T22:15:59.837 INFO:teuthology.task.ansible.out:y5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-22T22:16:00.092 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-22T22:16:00.188 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-22T22:16:00.190 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-22T22:16:00.447 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-22T22:16:00.449 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-22T22:16:00.557 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-22T22:16:00.559 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-22T22:16:00.825 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-22T22:16:00.826 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-22T22:16:00.828 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-22T22:16:00.900 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-22T22:16:00.938 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-22T22:16:01.187 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-22T22:16:01.267 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-22T22:16:01.290 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-22T22:16:01.544 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-22T22:16:01.609 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-22T22:16:01.633 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-22T22:16:01.878 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-22T22:16:01.976 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-22T22:16:01.981 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-22T22:16:02.233 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-22T22:16:02.328 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-22T22:16:02.350 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-22T22:16:02.582 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-22T22:16:02.703 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-22T22:16:02.704 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-22T22:16:02.942 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-22T22:16:03.028 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-22T22:16:03.040 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-22T22:16:03.303 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-22T22:16:03.378 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-22T22:16:03.380 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-22T22:16:03.390 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-22T22:16:03.636 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-22T22:16:03.736 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-22T22:16:03.738 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-22T22:16:03.779 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-22T22:16:03.968 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-22T22:16:03.970 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-22T22:16:04.118 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-22T22:16:04.153 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-22T22:16:04.303 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-22T22:16:04.467 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-22T22:16:04.469 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-22T22:16:04.639 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-22T22:16:04.741 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-22T22:16:04.827 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-22T22:16:04.975 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-22T22:16:04.980 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-22T22:16:05.029 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-22T22:16:05.159 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-22T22:16:05.316 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-22T22:16:05.397 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-22T22:16:05.398 INFO:teuthology.task.ansible.out: 2019-12-22T22:16:05.481 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-22T22:16:05.650 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-22T22:16:05.734 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-22T22:16:05.829 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-22T22:16:05.937 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-22T22:16:06.063 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-22T22:16:06.169 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-22T22:16:06.170 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-22T22:16:06.260 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-22T22:16:06.428 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-22T22:16:06.519 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-22T22:16:06.520 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-22T22:16:06.635 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-22T22:16:06.780 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-22T22:16:06.876 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-22T22:16:07.147 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-22T22:16:07.181 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-22T22:16:07.224 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-22T22:16:07.384 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-22T22:16:07.573 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-22T22:16:07.586 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-22T22:16:07.736 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-22T22:16:07.910 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-22T22:16:07.967 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-22T22:16:08.055 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-22T22:16:08.262 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-22T22:16:08.317 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-22T22:16:08.432 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-22T22:16:08.607 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-22T22:16:08.666 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-22T22:16:08.785 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-22T22:16:08.955 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-22T22:16:08.956 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-22T22:16:08.966 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-22T22:16:09.097 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-22T22:16:09.248 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-22T22:16:09.299 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-22T22:16:09.418 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-22T22:16:09.628 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-22T22:16:09.629 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-22T22:16:09.792 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-22T22:16:09.962 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-22T22:16:09.973 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-22T22:16:10.155 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-22T22:16:10.309 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-22T22:16:10.321 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2019-12-22T22:16:10.453 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:10 +0000 (0:00:25.513) 0:01:26.950 ******* 2019-12-22T22:16:10.461 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-22T22:16:10.498 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:10.499 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:10.511 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:10.521 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:10.533 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:10.534 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:10.545 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:10.556 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:10.568 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:10.579 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:10.687 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:10.688 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-22T22:16:10.807 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-22T22:16:10.924 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-22T22:16:10.947 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:11.021 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:11.023 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-22T22:16:11.168 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-22T22:16:11.285 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:11.286 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-22T22:16:11.391 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:11.392 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-22T22:16:11.501 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-22T22:16:11.633 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:11.634 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-22T22:16:11.749 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsri 2019-12-22T22:16:11.765 INFO:teuthology.task.ansible.out:vas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-22T22:16:11.847 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw 2019-12-22T22:16:11.850 INFO:teuthology.task.ansible.out:8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-22T22:16:11.982 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-22T22:16:11.994 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.005 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.016 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.027 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.040 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.050 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.052 INFO:teuthology.task.ansible.out: 2019-12-22T22:16:12.068 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.080 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.092 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.103 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.104 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:12.104 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-22T22:16:12.115 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:12.116 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.129 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.151 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.151 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.164 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.165 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.187 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.187 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.199 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.210 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:12.211 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac6 2019-12-22T22:16:12.213 INFO:teuthology.task.ansible.out:3dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.223 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.235 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.237 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.249 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.262 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.262 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.273 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.285 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.285 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.300 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.308 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.319 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.321 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.331 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.342 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.353 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.375 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.386 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.398 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.420 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.420 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.432 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:12.433 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.445 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.455 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.468 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.470 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.481 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.492 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.504 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.527 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.528 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.530 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.546 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:12.547 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:12.552 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": " 2019-12-22T22:16:12.554 INFO:teuthology.task.ansible.out:Conditional result was False"} 2019-12-22T22:16:12.576 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.589 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.590 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.602 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.603 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.615 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.627 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.638 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.654 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.655 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.667 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.679 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.690 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.702 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.715 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.716 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.728 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.740 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.755 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.756 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.768 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.779 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.781 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:12.782 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-22T22:16:12.809 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.822 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.838 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.853 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.855 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.867 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.879 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.879 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:12.880 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-22T22:16:12.902 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:12.904 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.917 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.918 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.924 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.935 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:12.988 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:12 +0000 (0:00:02.534) 0:01:29.484 ******* 2019-12-22T22:16:13.025 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-22T22:16:13.027 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.065 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:13 +0000 (0:00:00.077) 0:01:29.562 ******* 2019-12-22T22:16:13.127 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:13.128 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2019-12-22T22:16:13.236 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:13 +0000 (0:00:00.170) 0:01:29.733 ******* 2019-12-22T22:16:13.243 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-22T22:16:13.280 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:13.280 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.291 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.303 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.314 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.325 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.336 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.347 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.359 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.360 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.437 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi168.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-22T22:16:13.557 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:13.558 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-22T22:16:13.738 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-22T22:16:13.749 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:13.771 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:13.773 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-22T22:16:13.916 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:13.918 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-22T22:16:13.919 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-22T22:16:14.085 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:14.086 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-22T22:16:14.107 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:14.109 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-22T22:16:14.292 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:14.294 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-22T22:16:14.296 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-22T22:16:14.409 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:14.411 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-22T22:16:14.464 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:14.466 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-22T22:16:14.636 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:14.638 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-22T22:16:14.739 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:14.740 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-22T22:16:14.825 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:14.826 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-22T22:16:14.837 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.848 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.860 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.861 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.872 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.894 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.905 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.917 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.919 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.936 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.940 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.952 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.953 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.964 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.976 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:14.988 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ov 2019-12-22T22:16:14.990 INFO:teuthology.task.ansible.out:pn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.000 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.011 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.024 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.024 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.036 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.056 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.059 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.060 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.071 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:15.073 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.086 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.089 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.100 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.110 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.121 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.133 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.133 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.144 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.156 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.167 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.179 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.190 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.207 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.214 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.227 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.238 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.251 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.261 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.283 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.283 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.295 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.297 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.319 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.320 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-22T22:16:15.322 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.324 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.334 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.346 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.359 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.361 INFO:teuthology.task.ansible.out: skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.371 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.383 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.398 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.401 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.412 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.413 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi168.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-22T22:16:15.425 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:15.426 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.437 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.459 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.470 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.471 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.482 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.500 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.501 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.503 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.513 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.524 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.536 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.537 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.559 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.559 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.570 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.582 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.582 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.594 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.606 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.607 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.618 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.629 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:15.630 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-22T22:16:15.653 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:15.654 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.665 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.666 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.680 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.692 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.747 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:15 +0000 (0:00:02.510) 0:01:32.244 ******* 2019-12-22T22:16:15.777 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:15.777 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-22T22:16:15.779 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:15.834 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:15 +0000 (0:00:00.087) 0:01:32.331 ******* 2019-12-22T22:16:15.947 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:15.948 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-22T22:16:16.075 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:16.080 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-22T22:16:16.214 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-22T22:16:16.277 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:16.279 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-22T22:16:16.414 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:16.416 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-22T22:16:16.543 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-22T22:16:16.628 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:16.629 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-22T22:16:16.723 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:16.724 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-22T22:16:16.872 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-22T22:16:16.951 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-22T22:16:17.041 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:17.042 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-22T22:16:17.197 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-22T22:16:17.293 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:17.295 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-22T22:16:17.378 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:17.381 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-22T22:16:17.554 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-22T22:16:17.639 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:17.640 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-22T22:16:17.672 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:17.672 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-22T22:16:17.871 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-22T22:16:17.969 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-22T22:16:17.991 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:17.993 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-22T22:16:18.203 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi187.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-22T22:16:18.284 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-22T22:16:18.297 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi168.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-22T22:16:18.547 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-22T22:16:18.596 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-22T22:16:18.645 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:18.647 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-22T22:16:18.902 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-22T22:16:18.924 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:18.926 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-22T22:16:18.980 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:18.981 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-22T22:16:19.234 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:19.235 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-22T22:16:19.237 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-22T22:16:19.246 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:19.247 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-22T22:16:19.304 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-22T22:16:19.556 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-22T22:16:19.590 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:19.591 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-22T22:16:19.665 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:19.667 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-22T22:16:19.888 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-22T22:16:19.932 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:19.934 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-22T22:16:19.997 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:19.998 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-22T22:16:20.163 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-22T22:16:20.271 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:20.273 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-22T22:16:20.471 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:20.472 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-22T22:16:20.608 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:20.609 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** changed: [smithi168.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-22T22:16:20.649 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-22T22:16:20.768 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:20 +0000 (0:00:04.933) 0:01:37.265 ******* 2019-12-22T22:16:20.785 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:20.787 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-22T22:16:20.819 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:20.821 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:20.831 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:20.832 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:20.845 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:20.866 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:20.878 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:20.889 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:20.900 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:20.901 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:21.122 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:21.123 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-22T22:16:21.190 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-22T22:16:21.246 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:21.248 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf59 2019-12-22T22:16:21.250 INFO:teuthology.task.ansible.out:2607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:21.453 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:21.454 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-22T22:16:21.600 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:21.601 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-22T22:16:21.752 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:21.754 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-22T22:16:21.786 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-22T22:16:21.936 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:21.938 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-22T22:16:22.124 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:22.125 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-22T22:16:22.261 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:22.263 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-22T22:16:22.274 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.275 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:22.275 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-22T22:16:22.276 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.298 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.298 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.309 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.321 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.332 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.343 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.344 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.356 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.366 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.376 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.387 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.388 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.399 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.410 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.421 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.432 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.433 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.444 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.455 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.477 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:22.479 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-22T22:16:22.500 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-22T22:16:22.502 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.503 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.514 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.537 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.538 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.540 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.550 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.561 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.562 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.573 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.584 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.596 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.597 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.608 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.631 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.647 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.647 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.658 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.670 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.670 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.684 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.694 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.706 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.707 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.720 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.732 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.734 INFO:teuthology.task.ansible.out: skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.746 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.757 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.769 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.770 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.784 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.793 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.795 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.806 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.817 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.828 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.829 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:22.829 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-22T22:16:22.831 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.841 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.853 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.886 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:22.887 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-22T22:16:22.908 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.939 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.953 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.953 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.955 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.956 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.957 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.958 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.974 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.975 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.986 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.997 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:22.999 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.009 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.020 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.031 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.042 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.043 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.068 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.075 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.087 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.087 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.099 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.109 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.121 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.132 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.143 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.217 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:23 +0000 (0:00:02.448) 0:01:39.714 ******* 2019-12-22T22:16:23.219 INFO:teuthology.task.ansible.out: 2019-12-22T22:16:23.246 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-22T22:16:23.247 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:23.285 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:23 +0000 (0:00:00.067) 0:01:39.781 ******* 2019-12-22T22:16:23.457 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** changed: [smithi187.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-22T22:16:23.479 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-22T22:16:23.639 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-22T22:16:23.956 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-22T22:16:23.989 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-22T22:16:24.037 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-22T22:16:24.289 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-22T22:16:24.551 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-22T22:16:24.589 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-22T22:16:24.614 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-22T22:16:24.923 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-22T22:16:25.096 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-22T22:16:25.125 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-22T22:16:25.288 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-22T22:16:25.634 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-22T22:16:25.691 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-22T22:16:25.703 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-22T22:16:25.976 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-22T22:16:26.276 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-22T22:16:26.288 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-22T22:16:26.289 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-22T22:16:26.608 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-22T22:16:26.800 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-22T22:16:26.811 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-22T22:16:26.945 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-22T22:16:27.150 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-22T22:16:27.304 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-22T22:16:27.390 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-22T22:16:27.485 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-22T22:16:27.655 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-22T22:16:27.852 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-22T22:16:27.989 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-22T22:16:28.012 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-22T22:16:28.191 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-22T22:16:28.384 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-22T22:16:28.523 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-22T22:16:28.549 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-22T22:16:28.739 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-22T22:16:28.846 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-22T22:16:29.102 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-22T22:16:29.115 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-22T22:16:29.170 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-22T22:16:29.422 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-22T22:16:29.714 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-22T22:16:29.740 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-22T22:16:29.795 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-22T22:16:29.865 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:29 +0000 (0:00:06.580) 0:01:46.362 ******* 2019-12-22T22:16:30.044 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-22T22:16:30.045 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-22T22:16:30.384 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-22T22:16:30.409 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-22T22:16:30.730 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-22T22:16:30.990 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-22T22:16:30.991 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "checksum": "bcb7fb0987df16cc4ec0eb20567ca03f52e167d8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "66384b595a953a298cfd60e4301d14e6", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577052989.9-128334254512301/source", "state": "file", "uid": 0} 2019-12-22T22:16:31.031 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:31 +0000 (0:00:01.165) 0:01:47.528 ******* 2019-12-22T22:16:31.073 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:31.075 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-22T22:16:31.085 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-22T22:16:31.088 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => { "msg": "Host smithi168.front.sepia.ceph.com is running CentOS 7.6 (Core)" } TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:31.088 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-22T22:16:31.129 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:31 +0000 (0:00:00.098) 0:01:47.626 ******* 2019-12-22T22:16:31.184 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi168.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-22T22:16:31.225 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:31 +0000 (0:00:00.091) 0:01:47.718 ******* 2019-12-22T22:16:31.263 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-22T22:16:31.265 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:31.304 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:31 +0000 (0:00:00.082) 0:01:47.801 ******* 2019-12-22T22:16:31.411 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:31.413 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-22T22:16:31.620 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-22T22:16:31.738 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-22T22:16:31.765 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-22T22:16:31.767 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.102890", "end": "2019-12-22 22:16:31.726148", "rc": 0, "start": "2019-12-22 22:16:31.623258", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-22T22:16:31.822 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:31 +0000 (0:00:00.517) 0:01:48.318 ******* 2019-12-22T22:16:31.855 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-22T22:16:31.856 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:31.939 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:31 +0000 (0:00:00.117) 0:01:48.436 ******* 2019-12-22T22:16:31.980 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-22T22:16:31.982 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:32.039 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.099) 0:01:48.535 ******* 2019-12-22T22:16:32.064 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi187.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-22T22:16:32.093 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:32.138 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.099) 0:01:48.635 ******* 2019-12-22T22:16:32.176 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-22T22:16:32.177 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:32.239 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.097) 0:01:48.733 ******* 2019-12-22T22:16:32.243 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:32.243 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-22T22:16:32.267 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-22T22:16:32.269 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:32.309 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.072) 0:01:48.806 ******* 2019-12-22T22:16:32.363 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-22T22:16:32.364 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:32.427 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.118) 0:01:48.924 ******* 2019-12-22T22:16:32.480 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-22T22:16:32.482 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi168.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:32.524 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.095) 0:01:49.019 ******* 2019-12-22T22:16:32.569 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:32.626 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.103) 0:01:49.123 ******* 2019-12-22T22:16:32.653 INFO:teuthology.task.ansible.out: 2019-12-22T22:16:32.655 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:32.657 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-22T22:16:32.700 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:32.751 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.125) 0:01:49.248 ******* 2019-12-22T22:16:32.808 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.056) 0:01:49.304 ******* 2019-12-22T22:16:32.814 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-22T22:16:32.816 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:32.880 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.072) 0:01:49.377 ******* 2019-12-22T22:16:32.889 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:32.890 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-22T22:16:32.925 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:32.964 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:32 +0000 (0:00:00.083) 0:01:49.461 ******* 2019-12-22T22:16:33.004 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi168.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:33.042 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.077) 0:01:49.539 ******* 2019-12-22T22:16:33.080 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-22T22:16:33.082 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.126 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.083) 0:01:49.622 ******* 2019-12-22T22:16:33.166 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-22T22:16:33.168 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.223 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.097) 0:01:49.720 ******* 2019-12-22T22:16:33.266 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.303 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.079) 0:01:49.800 ******* 2019-12-22T22:16:33.330 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-22T22:16:33.332 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.374 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.070) 0:01:49.870 ******* 2019-12-22T22:16:33.400 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-22T22:16:33.402 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:33.446 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.070) 0:01:49.941 ******* 2019-12-22T22:16:33.451 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:33.451 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-22T22:16:33.475 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-22T22:16:33.476 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.511 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.067) 0:01:50.008 ******* 2019-12-22T22:16:33.550 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.587 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.075) 0:01:50.084 ******* 2019-12-22T22:16:33.617 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.657 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.070) 0:01:50.154 ******* 2019-12-22T22:16:33.695 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-22T22:16:33.696 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.732 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.075) 0:01:50.229 ******* 2019-12-22T22:16:33.765 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-22T22:16:33.767 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.807 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.074) 0:01:50.304 ******* 2019-12-22T22:16:33.844 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-22T22:16:33.846 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:33.881 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.074) 0:01:50.378 ******* 2019-12-22T22:16:33.909 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-22T22:16:33.911 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:33.948 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:33 +0000 (0:00:00.066) 0:01:50.444 ******* 2019-12-22T22:16:33.966 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** changed: [smithi071.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-22T22:16:33.977 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-22T22:16:33.979 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "checksum": "bcb7fb0987df16cc4ec0eb20567ca03f52e167d8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "66384b595a953a298cfd60e4301d14e6", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577052992.84-75999916153130/source", "state": "file", "uid": 0} TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-22T22:16:34.020 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.070) 0:01:50.514 ******* 2019-12-22T22:16:34.055 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.037) 0:01:50.552 ******* 2019-12-22T22:16:34.060 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-22T22:16:34.062 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:34.099 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.044) 0:01:50.596 ******* 2019-12-22T22:16:34.105 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-22T22:16:34.106 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => { "msg": "Host smithi187.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-22T22:16:34.161 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.061) 0:01:50.658 ******* 2019-12-22T22:16:34.212 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi187.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-22T22:16:34.258 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.096) 0:01:50.755 ******* 2019-12-22T22:16:34.288 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-22T22:16:34.290 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:34.330 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.072) 0:01:50.827 ******* 2019-12-22T22:16:34.444 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-22T22:16:34.445 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:16:34.483 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.152) 0:01:50.980 ******* 2019-12-22T22:16:34.545 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** changed: [smithi071.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-22T22:16:34.772 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-22T22:16:34.774 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.105008", "end": "2019-12-22 22:16:34.734990", "rc": 0, "start": "2019-12-22 22:16:34.629982", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-22T22:16:34.818 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.334) 0:01:51.314 ******* 2019-12-22T22:16:34.855 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:34.895 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.077) 0:01:51.392 ******* 2019-12-22T22:16:34.932 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-22T22:16:34.934 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:34.973 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:34 +0000 (0:00:00.078) 0:01:51.470 ******* 2019-12-22T22:16:35.000 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-22T22:16:35.002 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:35.038 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.064) 0:01:51.535 ******* 2019-12-22T22:16:35.078 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:35.119 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.081) 0:01:51.616 ******* 2019-12-22T22:16:35.125 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:35.126 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-22T22:16:35.158 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:35.200 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.078) 0:01:51.695 ******* 2019-12-22T22:16:35.244 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:35.287 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.088) 0:01:51.784 ******* 2019-12-22T22:16:35.337 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi187.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi187.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:35.378 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.091) 0:01:51.875 ******* 2019-12-22T22:16:35.416 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-22T22:16:35.418 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:35.459 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.080) 0:01:51.955 ******* 2019-12-22T22:16:35.492 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-22T22:16:35.496 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:35.531 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.072) 0:01:52.028 ******* 2019-12-22T22:16:35.569 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-22T22:16:35.570 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:35.639 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.107) 0:01:52.135 ******* 2019-12-22T22:16:35.661 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:35.662 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-22T22:16:35.703 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-22T22:16:35.705 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:35.796 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.157) 0:01:52.293 ******* 2019-12-22T22:16:35.820 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi168.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-22T22:16:35.854 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi187.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:35.904 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.108) 0:01:52.401 ******* 2019-12-22T22:16:35.952 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-22T22:16:35.953 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:35.998 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:35 +0000 (0:00:00.093) 0:01:52.495 ******* 2019-12-22T22:16:36.043 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:36.080 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.081) 0:01:52.576 ******* 2019-12-22T22:16:36.120 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-22T22:16:36.121 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:36.169 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.089) 0:01:52.666 ******* 2019-12-22T22:16:36.226 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-22T22:16:36.228 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:36.265 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.095) 0:01:52.762 ******* 2019-12-22T22:16:36.270 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:36.271 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-22T22:16:36.308 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi187.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:36.360 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.089) 0:01:52.851 ******* 2019-12-22T22:16:36.405 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-22T22:16:36.406 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:36.474 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.119) 0:01:52.970 ******* 2019-12-22T22:16:36.511 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-22T22:16:36.513 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:36.558 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.084) 0:01:53.055 ******* 2019-12-22T22:16:36.600 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:36.661 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.103) 0:01:53.158 ******* 2019-12-22T22:16:36.705 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-22T22:16:36.706 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:36.784 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.123) 0:01:53.281 ******* 2019-12-22T22:16:36.805 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-22T22:16:36.807 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-22T22:16:36.854 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.070) 0:01:53.351 ******* 2019-12-22T22:16:36.862 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-22T22:16:36.863 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:36.911 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:36 +0000 (0:00:00.056) 0:01:53.408 ******* 2019-12-22T22:16:36.918 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:36.918 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-22T22:16:36.956 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-22T22:16:36.957 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:37.008 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:37 +0000 (0:00:00.094) 0:01:53.502 ******* 2019-12-22T22:16:37.069 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi187.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:37.106 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:37 +0000 (0:00:00.101) 0:01:53.603 ******* 2019-12-22T22:16:37.140 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-22T22:16:37.199 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:37 +0000 (0:00:00.093) 0:01:53.696 ******* 2019-12-22T22:16:37.234 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:37.278 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:37 +0000 (0:00:00.078) 0:01:53.775 ******* 2019-12-22T22:16:37.476 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** changed: [smithi071.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-22T22:16:37.631 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-22T22:16:37.632 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:16:37.700 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:37 +0000 (0:00:00.421) 0:01:54.196 ******* 2019-12-22T22:16:37.856 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:37.861 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-22T22:16:38.191 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-22T22:16:38.193 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577052996.91-183784643501917/source", "state": "file", "uid": 0} 2019-12-22T22:16:38.218 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:38.219 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-22T22:16:38.596 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-22T22:16:38.870 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi187.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-22T22:16:38.914 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi071.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-22T22:16:39.239 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-22T22:16:39.432 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-22T22:16:39.433 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577052998.2-213750786487152/source", "state": "file", "uid": 0} 2019-12-22T22:16:39.473 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:39 +0000 (0:00:01.773) 0:01:55.970 ******* 2019-12-22T22:16:39.566 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:39.567 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-22T22:16:39.875 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-22T22:16:39.877 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-22T22:16:39.952 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:39 +0000 (0:00:00.479) 0:01:56.449 ******* 2019-12-22T22:16:39.959 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:39.960 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-22T22:16:40.218 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-22T22:16:40.219 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-22T22:16:40.518 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-22T22:16:40.520 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-22T22:16:40.561 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-22T22:16:40.566 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-12-22T22:16:40.608 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:40 +0000 (0:00:00.649) 0:01:57.099 ******* 2019-12-22T22:16:40.640 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:40 +0000 (0:00:00.037) 0:01:57.137 ******* 2019-12-22T22:16:41.184 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* changed: [smithi187.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577053000.0-135637028719499/source", "state": "file", "uid": 0} 2019-12-22T22:16:41.706 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-22T22:16:41.708 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "checksum": "bcb7fb0987df16cc4ec0eb20567ca03f52e167d8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "66384b595a953a298cfd60e4301d14e6", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577053000.63-42556073698903/source", "state": "file", "uid": 0} 2019-12-22T22:16:41.755 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:41 +0000 (0:00:01.114) 0:01:58.252 ******* 2019-12-22T22:16:41.797 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-22T22:16:41.799 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => { "msg": "Host smithi071.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-22T22:16:41.860 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:41 +0000 (0:00:00.104) 0:01:58.357 ******* 2019-12-22T22:16:41.899 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-22T22:16:41.901 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-22T22:16:41.949 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:41 +0000 (0:00:00.088) 0:01:58.446 ******* 2019-12-22T22:16:41.978 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-22T22:16:41.979 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:42.041 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:42 +0000 (0:00:00.092) 0:01:58.538 ******* 2019-12-22T22:16:42.262 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-22T22:16:42.267 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577053001.18-90386028127633/source", "state": "file", "uid": 0} 2019-12-22T22:16:42.309 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:42 +0000 (0:00:00.267) 0:01:58.805 ******* 2019-12-22T22:16:42.446 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-22T22:16:42.448 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.100473", "end": "2019-12-22 22:16:42.418011", "rc": 0, "start": "2019-12-22 22:16:42.317538", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-22T22:16:42.505 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:42 +0000 (0:00:00.196) 0:01:59.002 ******* 2019-12-22T22:16:42.534 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-22T22:16:42.535 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:42.587 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:42 +0000 (0:00:00.081) 0:01:59.084 ******* 2019-12-22T22:16:42.634 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:42.672 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:42 +0000 (0:00:00.083) 0:01:59.167 ******* 2019-12-22T22:16:42.687 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-22T22:16:42.689 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-22T22:16:42.710 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-22T22:16:42.711 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:42.746 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:42 +0000 (0:00:00.075) 0:01:59.243 ******* 2019-12-22T22:16:42.785 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-22T22:16:42.787 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:42.831 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:42 +0000 (0:00:00.085) 0:01:59.328 ******* 2019-12-22T22:16:42.874 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-22T22:16:42.876 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:42.914 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:42 +0000 (0:00:00.082) 0:01:59.411 ******* 2019-12-22T22:16:42.954 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:43.040 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.124) 0:01:59.536 ******* 2019-12-22T22:16:43.046 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-22T22:16:43.048 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-22T22:16:43.103 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.064) 0:01:59.600 ******* 2019-12-22T22:16:43.109 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-22T22:16:43.110 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:43.111 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:43.164 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.060) 0:01:59.661 ******* 2019-12-22T22:16:43.204 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-22T22:16:43.206 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:43.256 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.091) 0:01:59.752 ******* 2019-12-22T22:16:43.283 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-22T22:16:43.285 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:43.327 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.071) 0:01:59.823 ******* 2019-12-22T22:16:43.378 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-22T22:16:43.379 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:43.422 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.095) 0:01:59.919 ******* 2019-12-22T22:16:43.473 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-22T22:16:43.475 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:43.512 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.089) 0:02:00.009 ******* 2019-12-22T22:16:43.550 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-22T22:16:43.552 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:43.599 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.086) 0:02:00.095 ******* 2019-12-22T22:16:43.641 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-22T22:16:43.643 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:43.683 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.084) 0:02:00.180 ******* 2019-12-22T22:16:43.731 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-22T22:16:43.733 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:43.783 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.100) 0:02:00.280 ******* 2019-12-22T22:16:43.811 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-22T22:16:43.812 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:43.870 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.087) 0:02:00.367 ******* 2019-12-22T22:16:43.913 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:43.950 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:43 +0000 (0:00:00.079) 0:02:00.447 ******* 2019-12-22T22:16:43.979 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:44.023 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.072) 0:02:00.520 ******* 2019-12-22T22:16:44.050 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-22T22:16:44.052 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:44.088 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.064) 0:02:00.585 ******* 2019-12-22T22:16:44.121 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-22T22:16:44.122 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:44.168 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.079) 0:02:00.665 ******* 2019-12-22T22:16:44.208 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-22T22:16:44.210 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:44.247 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.078) 0:02:00.744 ******* 2019-12-22T22:16:44.274 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-22T22:16:44.275 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:44.313 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.066) 0:02:00.810 ******* 2019-12-22T22:16:44.352 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-22T22:16:44.353 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:44.390 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.076) 0:02:00.887 ******* 2019-12-22T22:16:44.417 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-22T22:16:44.418 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:44.459 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.068) 0:02:00.955 ******* 2019-12-22T22:16:44.500 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-22T22:16:44.501 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-22T22:16:44.559 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.099) 0:02:01.055 ******* 2019-12-22T22:16:44.588 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-22T22:16:44.629 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.070) 0:02:01.126 ******* 2019-12-22T22:16:44.657 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-22T22:16:44.658 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:44.693 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:44 +0000 (0:00:00.063) 0:02:01.190 ******* 2019-12-22T22:16:45.034 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-22T22:16:45.036 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:16:45.079 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:45 +0000 (0:00:00.385) 0:02:01.576 ******* 2019-12-22T22:16:46.077 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-22T22:16:46.078 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-22T22:16:47.010 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-22T22:16:47.051 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:47 +0000 (0:00:01.972) 0:02:03.548 ******* 2019-12-22T22:16:48.230 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* changed: [smithi071.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577053007.09-74210832218413/source", "state": "file", "uid": 0} 2019-12-22T22:16:49.441 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1577053008.25-186393066872495/source", "state": "file", "uid": 0} 2019-12-22T22:16:49.481 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:49 +0000 (0:00:02.429) 0:02:05.978 ******* 2019-12-22T22:16:49.847 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-22T22:16:49.849 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-22T22:16:50.162 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-22T22:16:50.202 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:50 +0000 (0:00:00.717) 0:02:06.696 ******* 2019-12-22T22:16:52.299 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:11.334224", "end": "2019-12-22 22:16:52.262402", "rc": 0, "start": "2019-12-22 22:16:40.928178", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.umd.edu\n * extras: mirror.atlanticmetro.net\n * updates: repos-va.psychz.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.umd.edu", " * extras: mirror.atlanticmetro.net", " * updates: repos-va.psychz.net", "Metadata Cache Created"]} 2019-12-22T22:16:52.343 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:52 +0000 (0:00:02.143) 0:02:08.840 ******* 2019-12-22T22:16:52.708 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-22T22:16:52.709 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-22T22:16:53.054 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-22T22:16:53.108 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:53 +0000 (0:00:00.765) 0:02:09.605 ******* 2019-12-22T22:16:53.138 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-22T22:16:53.145 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:53.184 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:53 +0000 (0:00:00.074) 0:02:09.679 ******* 2019-12-22T22:16:53.210 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:53.267 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:53 +0000 (0:00:00.084) 0:02:09.764 ******* 2019-12-22T22:16:53.298 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-22T22:16:53.300 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:53.353 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:53 +0000 (0:00:00.086) 0:02:09.850 ******* 2019-12-22T22:16:53.382 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-22T22:16:53.384 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:53.434 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:53 +0000 (0:00:00.080) 0:02:09.930 ******* 2019-12-22T22:16:53.466 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-22T22:16:53.467 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:53.504 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:53 +0000 (0:00:00.070) 0:02:10.001 ******* 2019-12-22T22:16:53.542 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-22T22:16:53.544 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:53.587 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:53 +0000 (0:00:00.082) 0:02:10.083 ******* 2019-12-22T22:16:53.614 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-22T22:16:53.616 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:53.654 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:53 +0000 (0:00:00.067) 0:02:10.150 ******* 2019-12-22T22:16:53.681 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-22T22:16:53.682 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:53.739 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:53 +0000 (0:00:00.081) 0:02:10.232 ******* 2019-12-22T22:16:54.531 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-22T22:16:54.533 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.497291", "end": "2019-12-22 22:16:54.500472", "rc": 0, "start": "2019-12-22 22:16:54.003181", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:16:54.573 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:54 +0000 (0:00:00.838) 0:02:11.070 ******* 2019-12-22T22:16:55.066 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-22T22:16:55.067 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:11.615873", "end": "2019-12-22 22:16:55.030847", "rc": 0, "start": "2019-12-22 22:16:43.414974", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.umd.edu\n * extras: mirror.fileplanet.com\n * updates: repos-va.psychz.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.umd.edu", " * extras: mirror.fileplanet.com", " * updates: repos-va.psychz.net", "Metadata Cache Created"]} 2019-12-22T22:16:55.105 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:55 +0000 (0:00:00.532) 0:02:11.602 ******* 2019-12-22T22:16:55.446 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-22T22:16:55.447 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-22T22:16:55.473 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-22T22:16:55.475 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-22T22:16:55.519 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:55 +0000 (0:00:00.413) 0:02:12.016 ******* 2019-12-22T22:16:55.549 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-22T22:16:55.550 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:55.590 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:55 +0000 (0:00:00.071) 0:02:12.087 ******* 2019-12-22T22:16:55.619 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:55.656 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:55 +0000 (0:00:00.065) 0:02:12.152 ******* 2019-12-22T22:16:55.684 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-22T22:16:55.685 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:55.733 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:55 +0000 (0:00:00.077) 0:02:12.230 ******* 2019-12-22T22:16:55.787 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Uncomment mirrorlist] ******************************************* changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-22T22:16:55.818 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:55 +0000 (0:00:00.084) 0:02:12.314 ******* 2019-12-22T22:16:55.855 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:55 +0000 (0:00:00.036) 0:02:12.351 ******* 2019-12-22T22:16:55.888 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:55.924 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:55 +0000 (0:00:00.069) 0:02:12.421 ******* 2019-12-22T22:16:55.960 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:56.009 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:56 +0000 (0:00:00.084) 0:02:12.506 ******* 2019-12-22T22:16:56.059 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:56.095 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:56 +0000 (0:00:00.085) 0:02:12.592 ******* 2019-12-22T22:16:56.121 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-22T22:16:56.123 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:56.158 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:56 +0000 (0:00:00.063) 0:02:12.655 ******* 2019-12-22T22:16:56.185 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-22T22:16:56.187 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:56.235 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:56 +0000 (0:00:00.076) 0:02:12.732 ******* 2019-12-22T22:16:56.268 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:56.304 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:56 +0000 (0:00:00.068) 0:02:12.801 ******* 2019-12-22T22:16:56.332 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:56.394 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:56 +0000 (0:00:00.089) 0:02:12.890 ******* 2019-12-22T22:16:56.430 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-22T22:16:56.432 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:56.485 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:56 +0000 (0:00:00.091) 0:02:12.982 ******* 2019-12-22T22:16:56.731 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-22T22:16:56.763 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-22T22:16:56.773 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:56 +0000 (0:00:00.286) 0:02:13.268 ******* 2019-12-22T22:16:57.540 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.734074", "end": "2019-12-22 22:16:57.500457", "rc": 0, "start": "2019-12-22 22:16:56.766383", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:16:57.601 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:57 +0000 (0:00:00.828) 0:02:14.098 ******* 2019-12-22T22:16:58.107 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-22T22:16:58.109 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-22T22:16:58.153 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:58 +0000 (0:00:00.552) 0:02:14.650 ******* 2019-12-22T22:16:58.185 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:58.231 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:58 +0000 (0:00:00.070) 0:02:14.721 ******* 2019-12-22T22:16:58.252 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-22T22:16:58.254 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:58.292 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:58 +0000 (0:00:00.068) 0:02:14.789 ******* 2019-12-22T22:16:58.320 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-22T22:16:58.322 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:58.358 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:58 +0000 (0:00:00.065) 0:02:14.855 ******* 2019-12-22T22:16:58.396 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-22T22:16:58.398 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:16:58.459 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:58 +0000 (0:00:00.100) 0:02:14.956 ******* 2019-12-22T22:16:59.327 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-22T22:16:59.328 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-22T22:16:59.371 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:16:59 +0000 (0:00:00.911) 0:02:15.868 ******* 2019-12-22T22:17:00.692 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-22T22:17:00.693 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-22T22:17:00.730 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:00 +0000 (0:00:01.359) 0:02:17.227 ******* 2019-12-22T22:17:01.737 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-22T22:17:01.738 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-22T22:17:02.439 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-22T22:17:02.440 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:11.905957", "end": "2019-12-22 22:17:02.415189", "rc": 0, "start": "2019-12-22 22:16:50.509232", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.umd.edu\n * extras: mirror.fileplanet.com\n * updates: repos-va.psychz.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.umd.edu", " * extras: mirror.fileplanet.com", " * updates: repos-va.psychz.net", "Metadata Cache Created"]} 2019-12-22T22:17:02.489 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:02 +0000 (0:00:01.758) 0:02:18.986 ******* 2019-12-22T22:17:02.634 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-22T22:17:02.635 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-22T22:17:02.867 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-22T22:17:02.868 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-22T22:17:03.213 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-22T22:17:03.274 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.785) 0:02:19.771 ******* 2019-12-22T22:17:03.312 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-22T22:17:03.314 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:03.352 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.077) 0:02:19.849 ******* 2019-12-22T22:17:03.382 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-22T22:17:03.383 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:03.426 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.073) 0:02:19.923 ******* 2019-12-22T22:17:03.442 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-22T22:17:03.443 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-22T22:17:03.485 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.059) 0:02:19.982 ******* 2019-12-22T22:17:03.495 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-22T22:17:03.532 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.046) 0:02:20.029 ******* 2019-12-22T22:17:03.575 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.042) 0:02:20.072 ******* 2019-12-22T22:17:03.580 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-22T22:17:03.582 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:03.622 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.047) 0:02:20.119 ******* 2019-12-22T22:17:03.664 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-22T22:17:03.666 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:03.704 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.082) 0:02:20.201 ******* 2019-12-22T22:17:03.743 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:03.779 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.075) 0:02:20.276 ******* 2019-12-22T22:17:03.781 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:03.807 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:03.809 INFO:teuthology.task.ansible.out:TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Create /usr/libexec.] ******************************************* 2019-12-22T22:17:03.811 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-22T22:17:03.846 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.066) 0:02:20.343 ******* 2019-12-22T22:17:03.848 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:03.887 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.041) 0:02:20.384 ******* 2019-12-22T22:17:03.889 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:03.895 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-22T22:17:03.896 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:03.935 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:03 +0000 (0:00:00.047) 0:02:20.432 ******* 2019-12-22T22:17:03.937 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:04.651 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-22T22:17:04.652 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-22T22:17:04.835 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi168.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-22T22:17:05.525 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-22T22:17:05.527 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.259960", "end": "2019-12-22 22:17:05.500442", "rc": 0, "start": "2019-12-22 22:17:04.240482", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:17:05.591 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:05 +0000 (0:00:01.653) 0:02:22.085 ******* 2019-12-22T22:17:05.629 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-22T22:17:05.630 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-22T22:17:05.705 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-22T22:17:05.707 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-22T22:17:06.097 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-22T22:17:06.099 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-22T22:17:06.144 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.555) 0:02:22.641 ******* 2019-12-22T22:17:06.184 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-22T22:17:06.185 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:06.227 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.083) 0:02:22.724 ******* 2019-12-22T22:17:06.254 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-22T22:17:06.256 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:06.295 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.064) 0:02:22.788 ******* 2019-12-22T22:17:06.319 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-22T22:17:06.321 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:06.363 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.071) 0:02:22.860 ******* 2019-12-22T22:17:06.364 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:06.391 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:06.393 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:06.432 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.068) 0:02:22.929 ******* 2019-12-22T22:17:06.434 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:06.526 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-22T22:17:06.528 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-22T22:17:06.576 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.142) 0:02:23.071 ******* 2019-12-22T22:17:06.625 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-22T22:17:06.626 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-22T22:17:06.675 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.100) 0:02:23.172 ******* 2019-12-22T22:17:06.702 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-22T22:17:06.704 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:06.750 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.075) 0:02:23.247 ******* 2019-12-22T22:17:06.789 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-22T22:17:06.791 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-22T22:17:06.829 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.078) 0:02:23.326 ******* 2019-12-22T22:17:06.898 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-22T22:17:06.899 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-22T22:17:06.938 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:06 +0000 (0:00:00.108) 0:02:23.434 ******* 2019-12-22T22:17:07.154 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-22T22:17:07.156 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-22T22:17:07.227 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:07 +0000 (0:00:00.288) 0:02:23.723 ******* 2019-12-22T22:17:07.288 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-22T22:17:07.302 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:07.311 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:07.322 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:07.324 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-22T22:17:07.326 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-22T22:17:07.363 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:07 +0000 (0:00:00.137) 0:02:23.860 ******* 2019-12-22T22:17:07.402 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:07 +0000 (0:00:00.038) 0:02:23.899 ******* 2019-12-22T22:17:07.834 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-22T22:17:07.835 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-22T22:17:08.882 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-22T22:17:10.328 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-22T22:17:10.372 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:10 +0000 (0:00:02.969) 0:02:26.868 ******* 2019-12-22T22:17:10.402 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-22T22:17:10.403 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:10.448 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:10 +0000 (0:00:00.076) 0:02:26.945 ******* 2019-12-22T22:17:10.485 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-22T22:17:10.487 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-22T22:17:10.536 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:10 +0000 (0:00:00.087) 0:02:27.033 ******* 2019-12-22T22:17:10.810 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-22T22:17:10.849 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:10 +0000 (0:00:00.313) 0:02:27.346 ******* 2019-12-22T22:17:10.877 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-22T22:17:10.880 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-22T22:17:10.920 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:10 +0000 (0:00:00.071) 0:02:27.417 ******* 2019-12-22T22:17:10.926 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-22T22:17:10.926 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:10.965 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:10 +0000 (0:00:00.044) 0:02:27.461 ******* 2019-12-22T22:17:10.992 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-22T22:17:10.994 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:11.004 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:11.026 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:11.037 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:11.080 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:11 +0000 (0:00:00.111) 0:02:27.573 ******* 2019-12-22T22:17:11.300 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-22T22:17:11.301 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-22T22:17:11.348 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:11 +0000 (0:00:00.272) 0:02:27.845 ******* 2019-12-22T22:17:11.815 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-22T22:17:11.815 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-22T22:17:11.853 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:11 +0000 (0:00:00.504) 0:02:28.350 ******* 2019-12-22T22:17:12.362 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi071.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-22T22:17:12.775 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-22T22:17:12.777 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-22T22:17:12.822 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:12 +0000 (0:00:00.968) 0:02:29.319 ******* 2019-12-22T22:17:12.849 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-22T22:17:12.851 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:12.890 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:12 +0000 (0:00:00.068) 0:02:29.387 ******* 2019-12-22T22:17:13.236 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:13.238 INFO:teuthology.task.ansible.out:TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi168.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:17:13.280 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:13 +0000 (0:00:00.390) 0:02:29.777 ******* 2019-12-22T22:17:13.313 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-22T22:17:13.314 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-22T22:17:13.672 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi168.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-22T22:17:13.713 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:13 +0000 (0:00:00.432) 0:02:30.210 ******* 2019-12-22T22:17:13.742 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-22T22:17:13.744 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:13.792 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:13 +0000 (0:00:00.079) 0:02:30.289 ******* 2019-12-22T22:17:14.219 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-22T22:17:14.221 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-22T22:17:14.265 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:14 +0000 (0:00:00.472) 0:02:30.761 ******* 2019-12-22T22:17:14.495 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-22T22:17:14.507 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-22T22:17:14.536 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:14 +0000 (0:00:00.271) 0:02:31.033 ******* 2019-12-22T22:17:14.564 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:14.604 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:14 +0000 (0:00:00.067) 0:02:31.101 ******* 2019-12-22T22:17:14.606 INFO:teuthology.task.ansible.out: 2019-12-22T22:17:14.615 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-22T22:17:14.656 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:14 +0000 (0:00:00.052) 0:02:31.153 ******* 2019-12-22T22:17:14.705 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-22T22:17:14.707 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-22T22:17:14.752 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:14 +0000 (0:00:00.091) 0:02:31.244 ******* 2019-12-22T22:17:15.509 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-22T22:17:15.510 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-22T22:17:15.547 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:15 +0000 (0:00:00.799) 0:02:32.044 ******* 2019-12-22T22:17:15.553 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-22T22:17:15.554 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-22T22:17:15.641 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-22T22:17:15.642 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2019-12-22 22:14:29 UTC", "ActiveEnterTimestampMonotonic": "19455133", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket system.slice network.target local-fs.target nss-lookup.target basic.target time-sync.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Sun 2019-12-22 22:14:29 UTC", "AssertTimestampMonotonic": "19454482", "Before": "shutdown.target multi-user.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2019-12-22 22:14:29 UTC", "ConditionTimestampMonotonic": "19454482", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8937", "ExecMainStartTimestamp": "Sun 2019-12-22 22:14:29 UTC", "ExecMainStartTimestampMonotonic": "19455071", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-22T22:17:15.644 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Sun 2019-12-22 22:14:29 UTC] ; stop_time=[n/a] ; pid=8937 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2019-12-22 22:14:29 UTC", "InactiveExitTimestampMonotonic": "19455133", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8937", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-22T22:17:15.646 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Sun 2019-12-22 22:14:29 UTC", "WatchdogTimestampMonotonic": "19455111", "WatchdogUSec": "0"}} 2019-12-22T22:17:15.686 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:15 +0000 (0:00:00.138) 0:02:32.183 ******* 2019-12-22T22:17:16.001 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-22T22:17:16.002 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004450", "end": "2019-12-22 22:17:15.969825", "rc": 0, "start": "2019-12-22 22:17:15.965375", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-22T22:17:16.041 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:16 +0000 (0:00:00.355) 0:02:32.538 ******* 2019-12-22T22:17:16.412 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-22T22:17:16.412 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-22T22:17:16.455 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-22T22:17:16.457 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-22T22:17:16.511 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:16 +0000 (0:00:00.470) 0:02:33.008 ******* 2019-12-22T22:17:16.517 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-22T22:17:16.518 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-22T22:17:16.558 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:16 +0000 (0:00:00.046) 0:02:33.055 ******* 2019-12-22T22:17:16.564 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-22T22:17:16.566 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:16.604 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:16 +0000 (0:00:00.046) 0:02:33.101 ******* 2019-12-22T22:17:16.920 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi187.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:17:16.959 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:16 +0000 (0:00:00.354) 0:02:33.456 ******* 2019-12-22T22:17:17.270 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-22T22:17:17.271 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-22T22:17:17.314 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:17 +0000 (0:00:00.354) 0:02:33.811 ******* 2019-12-22T22:17:17.334 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-22T22:17:17.335 INFO:teuthology.task.ansible.out:fatal: [smithi187.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-22T22:17:17.371 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:17 +0000 (0:00:00.057) 0:02:33.868 ******* 2019-12-22T22:17:17.377 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-22T22:17:17.378 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:17.421 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:17 +0000 (0:00:00.049) 0:02:33.918 ******* 2019-12-22T22:17:17.428 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-22T22:17:17.429 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:17.468 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:17 +0000 (0:00:00.046) 0:02:33.965 ******* 2019-12-22T22:17:17.474 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-22T22:17:17.474 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-22T22:17:17.513 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:17 +0000 (0:00:00.045) 0:02:34.010 ******* 2019-12-22T22:17:17.852 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-22T22:17:17.903 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:17 +0000 (0:00:00.389) 0:02:34.399 ******* 2019-12-22T22:17:17.941 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-22T22:17:17.942 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:17.963 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:17.974 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:17.985 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-22T22:17:18.036 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:18 +0000 (0:00:00.130) 0:02:34.530 ******* 2019-12-22T22:17:18.433 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-22T22:17:18.434 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-22T22:17:18.505 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:18 +0000 (0:00:00.463) 0:02:34.994 ******* 2019-12-22T22:17:18.951 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-22T22:17:18.953 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2019-12-22 22:14:23 UTC", "ActiveEnterTimestampMonotonic": "19317458", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target time-sync.target network.target system.slice systemd-journald.socket basic.target local-fs.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Sun 2019-12-22 22:14:23 UTC", "AssertTimestampMonotonic": "19316859", "Before": "xdm.service multi-user.target shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2019-12-22 22:14:23 UTC", "ConditionTimestampMonotonic": "19316857", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8976", "ExecMainStartTimestamp": "Sun 2019-12-22 22:14:23 UTC", "ExecMainStartTimestampMonotonic": "19317389", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-22T22:17:18.954 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Sun 2019-12-22 22:14:23 UTC] ; stop_time=[n/a] ; pid=8976 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2019-12-22 22:14:23 UTC", "InactiveExitTimestampMonotonic": "19317458", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8976", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-22T22:17:18.956 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Sun 2019-12-22 22:14:23 UTC", "WatchdogTimestampMonotonic": "19317429", "WatchdogUSec": "0"}} 2019-12-22T22:17:18.996 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:18 +0000 (0:00:00.498) 0:02:35.492 ******* 2019-12-22T22:17:19.297 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-22T22:17:19.299 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004839", "end": "2019-12-22 22:17:19.266238", "rc": 0, "start": "2019-12-22 22:17:19.261399", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-22T22:17:19.354 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:19 +0000 (0:00:00.358) 0:02:35.851 ******* 2019-12-22T22:17:19.847 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-22T22:17:19.849 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-22T22:17:19.890 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:19 +0000 (0:00:00.535) 0:02:36.387 ******* 2019-12-22T22:17:21.407 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-22T22:17:21.408 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-22T22:17:21.447 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:21 +0000 (0:00:01.557) 0:02:37.944 ******* 2019-12-22T22:17:21.485 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-22T22:17:21.487 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:21.522 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:21 +0000 (0:00:00.074) 0:02:38.019 ******* 2019-12-22T22:17:22.406 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-22T22:17:22.444 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:22 +0000 (0:00:00.921) 0:02:38.940 ******* 2019-12-22T22:17:23.300 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-22T22:17:23.302 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-22T22:17:23.351 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:23 +0000 (0:00:00.907) 0:02:39.848 ******* 2019-12-22T22:17:23.389 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-22T22:17:23.391 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:23.432 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:23 +0000 (0:00:00.080) 0:02:39.929 ******* 2019-12-22T22:17:23.787 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-22T22:17:23.789 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:17:23.825 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:23 +0000 (0:00:00.392) 0:02:40.322 ******* 2019-12-22T22:17:24.206 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi071.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-22T22:17:24.244 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:24 +0000 (0:00:00.415) 0:02:40.737 ******* 2019-12-22T22:17:24.280 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-22T22:17:24.281 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:17:24.318 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:24 +0000 (0:00:00.077) 0:02:40.815 ******* 2019-12-22T22:17:25.277 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-22T22:17:25.279 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-22T22:17:25.318 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:25 +0000 (0:00:00.999) 0:02:41.815 ******* 2019-12-22T22:17:25.761 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-22T22:17:25.762 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2019-12-22 22:14:32 UTC", "ActiveEnterTimestampMonotonic": "19042973", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount local-fs.target time-sync.target systemd-journald.socket network.target basic.target system.slice nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Sun 2019-12-22 22:14:32 UTC", "AssertTimestampMonotonic": "19042069", "Before": "shutdown.target xdm.service getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2019-12-22 22:14:32 UTC", "ConditionTimestampMonotonic": "19042068", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8970", "ExecMainStartTimestamp": "Sun 2019-12-22 22:14:32 UTC", "ExecMainStartTimestampMonotonic": "19042879", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-22T22:17:25.764 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Sun 2019-12-22 22:14:32 UTC] ; stop_time=[n/a] ; pid=8970 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2019-12-22 22:14:32 UTC", "InactiveExitTimestampMonotonic": "19042973", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8970", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-22T22:17:25.765 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Sun 2019-12-22 22:14:32 UTC", "WatchdogTimestampMonotonic": "19042929", "WatchdogUSec": "0"}} 2019-12-22T22:17:25.799 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:25 +0000 (0:00:00.480) 0:02:42.296 ******* 2019-12-22T22:17:26.137 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-22T22:17:26.139 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004739", "end": "2019-12-22 22:17:26.110426", "rc": 0, "start": "2019-12-22 22:17:26.105687", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-22T22:17:26.182 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:26 +0000 (0:00:00.383) 0:02:42.679 ******* 2019-12-22T22:17:26.661 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-22T22:17:26.662 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-22T22:17:26.702 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:26 +0000 (0:00:00.520) 0:02:43.199 ******* 2019-12-22T22:17:42.687 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.umd.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.atlanticmetro.net\n * updates: repos-va.psychz.net\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n---------------------------------------- 2019-12-22T22:17:42.689 INFO:teuthology.task.ansible.out:----------------------------------------\nTotal 25 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-22T22:17:42.735 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:42 +0000 (0:00:16.032) 0:02:59.232 ******* 2019-12-22T22:17:43.586 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-22T22:17:43.588 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-22T22:17:43.625 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:43 +0000 (0:00:00.890) 0:03:00.122 ******* 2019-12-22T22:17:46.039 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-22T22:17:46.040 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.umd.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.fileplanet.com\n * updates: repos-va.psychz.net\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-22T22:17:46.041 INFO:teuthology.task.ansible.out: 21 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-22T22:17:46.079 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:46 +0000 (0:00:02.453) 0:03:02.576 ******* 2019-12-22T22:17:46.641 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-22T22:17:46.641 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-22T22:17:46.686 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:46 +0000 (0:00:00.604) 0:03:03.181 ******* 2019-12-22T22:17:51.724 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-22T22:17:51.724 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.759747", "end": "2019-12-22 22:17:51.691096", "failed_when_result": false, "rc": 0, "start": "2019-12-22 22:17:43.931349", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-22T22:17:51.764 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:51 +0000 (0:00:05.080) 0:03:08.261 ******* 2019-12-22T22:17:52.738 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-22T22:17:52.739 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-22T22:17:52.788 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:52 +0000 (0:00:01.024) 0:03:09.285 ******* 2019-12-22T22:17:53.126 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-22T22:17:53.127 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.017415", "end": "2019-12-22 22:17:53.094637", "rc": 0, "start": "2019-12-22 22:17:53.077222", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-22T22:17:53.165 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:53 +0000 (0:00:00.376) 0:03:09.662 ******* 2019-12-22T22:17:53.510 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-22T22:17:53.512 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.020747", "end": "2019-12-22 22:17:53.468081", "rc": 0, "start": "2019-12-22 22:17:53.447334", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:17:53.553 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:53 +0000 (0:00:00.387) 0:03:10.050 ******* 2019-12-22T22:17:54.035 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-22T22:17:54.036 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.umd.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.fileplanet.com\n * updates: repos-va.psychz.net\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-22T22:17:54.037 INFO:teuthology.task.ansible.out: 24 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-22T22:17:54.074 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:54 +0000 (0:00:00.521) 0:03:10.571 ******* 2019-12-22T22:17:54.615 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-22T22:17:54.616 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-22T22:17:54.653 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:54 +0000 (0:00:00.578) 0:03:11.150 ******* 2019-12-22T22:17:54.806 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-22T22:17:54.807 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.793198", "end": "2019-12-22 22:17:54.772107", "failed_when_result": false, "rc": 0, "start": "2019-12-22 22:17:46.978909", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-22T22:17:54.846 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:54 +0000 (0:00:00.192) 0:03:11.343 ******* 2019-12-22T22:17:55.725 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-22T22:17:55.726 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-22T22:17:55.773 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:55 +0000 (0:00:00.926) 0:03:12.270 ******* 2019-12-22T22:17:56.104 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-22T22:17:56.105 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.015469", "end": "2019-12-22 22:17:56.075975", "rc": 0, "start": "2019-12-22 22:17:56.060506", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-22T22:17:56.143 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:56 +0000 (0:00:00.369) 0:03:12.640 ******* 2019-12-22T22:17:56.482 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-22T22:17:56.483 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.022041", "end": "2019-12-22 22:17:56.453077", "rc": 0, "start": "2019-12-22 22:17:56.431036", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:17:56.519 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:17:56 +0000 (0:00:00.376) 0:03:13.016 ******* 2019-12-22T22:18:01.725 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-22T22:18:01.726 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.825372", "end": "2019-12-22 22:18:01.686614", "rc": 0, "start": "2019-12-22 22:17:53.861242", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:18:01.764 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:01 +0000 (0:00:05.244) 0:03:18.261 ******* 2019-12-22T22:18:02.130 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-22T22:18:02.132 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-22T22:18:02.168 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:02 +0000 (0:00:00.403) 0:03:18.665 ******* 2019-12-22T22:18:02.216 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-22T22:18:02.217 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-22T22:18:02.256 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:02 +0000 (0:00:00.088) 0:03:18.753 ******* 2019-12-22T22:18:02.294 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-22T22:18:02.295 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-22T22:18:02.332 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:02 +0000 (0:00:00.075) 0:03:18.829 ******* 2019-12-22T22:18:02.371 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-22T22:18:02.372 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "python3"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-22T22:18:02.410 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:02 +0000 (0:00:00.078) 0:03:18.907 ******* 2019-12-22T22:18:02.458 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-22T22:18:02.460 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-22T22:18:02.497 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:02 +0000 (0:00:00.087) 0:03:18.994 ******* 2019-12-22T22:18:02.813 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-22T22:18:02.814 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.832231", "end": "2019-12-22 22:18:02.783335", "failed_when_result": false, "rc": 0, "start": "2019-12-22 22:17:54.951104", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-22T22:18:02.857 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:02 +0000 (0:00:00.359) 0:03:19.354 ******* 2019-12-22T22:18:02.864 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-22T22:18:02.866 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-22T22:18:02.904 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:02 +0000 (0:00:00.046) 0:03:19.401 ******* 2019-12-22T22:18:03.247 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-22T22:18:03.249 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-22T22:18:03.283 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:03 +0000 (0:00:00.378) 0:03:19.780 ******* 2019-12-22T22:18:03.310 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-22T22:18:03.312 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:03.348 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:03 +0000 (0:00:00.065) 0:03:19.845 ******* 2019-12-22T22:18:03.382 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-22T22:18:03.384 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:03.421 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:03 +0000 (0:00:00.072) 0:03:19.918 ******* 2019-12-22T22:18:03.804 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-22T22:18:03.806 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-22T22:18:03.806 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-22T22:18:03.846 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:03 +0000 (0:00:00.425) 0:03:20.343 ******* 2019-12-22T22:18:03.891 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:03 +0000 (0:00:00.044) 0:03:20.388 ******* 2019-12-22T22:18:04.436 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-22T22:18:04.436 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.019614", "end": "2019-12-22 22:18:04.407243", "rc": 0, "start": "2019-12-22 22:18:04.387629", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-22T22:18:04.476 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:04 +0000 (0:00:00.584) 0:03:20.973 ******* 2019-12-22T22:18:04.685 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-22T22:18:04.686 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.848387", "end": "2019-12-22 22:18:04.647781", "rc": 0, "start": "2019-12-22 22:17:56.799394", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:18:04.734 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:04 +0000 (0:00:00.258) 0:03:21.231 ******* 2019-12-22T22:18:04.803 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-22T22:18:04.805 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.018966", "end": "2019-12-22 22:18:04.775188", "rc": 0, "start": "2019-12-22 22:18:04.756222", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:18:04.850 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:04 +0000 (0:00:00.115) 0:03:21.346 ******* 2019-12-22T22:18:04.939 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-22T22:18:04.941 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-22T22:18:04.978 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:04 +0000 (0:00:00.128) 0:03:21.475 ******* 2019-12-22T22:18:05.017 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-22T22:18:05.019 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi168"}, "changed": false} 2019-12-22T22:18:05.053 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:05 +0000 (0:00:00.074) 0:03:21.550 ******* 2019-12-22T22:18:05.081 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-22T22:18:05.083 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-22T22:18:05.120 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:05 +0000 (0:00:00.066) 0:03:21.617 ******* 2019-12-22T22:18:05.168 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-22T22:18:05.169 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-22T22:18:05.211 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:05 +0000 (0:00:00.091) 0:03:21.708 ******* 2019-12-22T22:18:05.248 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-22T22:18:05.250 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-22T22:18:05.287 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:05 +0000 (0:00:00.076) 0:03:21.784 ******* 2019-12-22T22:18:05.335 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-22T22:18:05.336 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "python3"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-22T22:18:05.375 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:05 +0000 (0:00:00.087) 0:03:21.871 ******* 2019-12-22T22:18:05.412 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-22T22:18:05.414 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-22T22:18:05.453 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:05 +0000 (0:00:00.077) 0:03:21.949 ******* 2019-12-22T22:18:05.763 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-22T22:18:05.764 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-22T22:18:05.801 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:05 +0000 (0:00:00.348) 0:03:22.298 ******* 2019-12-22T22:18:06.094 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-22T22:18:06.096 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi168.front.sepia.ceph.com", "ansible_hostname": "smithi168", "ansible_nodename": "smithi168"}, "changed": true, "name": "smithi168"} 2019-12-22T22:18:06.132 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:06 +0000 (0:00:00.330) 0:03:22.629 ******* 2019-12-22T22:18:06.137 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-22T22:18:06.139 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-22T22:18:06.175 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:06 +0000 (0:00:00.043) 0:03:22.672 ******* 2019-12-22T22:18:06.201 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-22T22:18:06.203 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:06.240 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:06 +0000 (0:00:00.064) 0:03:22.737 ******* 2019-12-22T22:18:06.267 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-22T22:18:06.268 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:06.304 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:06 +0000 (0:00:00.064) 0:03:22.801 ******* 2019-12-22T22:18:06.676 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-22T22:18:06.677 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-22T22:18:06.722 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:06 +0000 (0:00:00.418) 0:03:23.219 ******* 2019-12-22T22:18:07.042 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-22T22:18:07.044 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-22T22:18:07.079 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:07 +0000 (0:00:00.357) 0:03:23.576 ******* 2019-12-22T22:18:07.695 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-22T22:18:07.696 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-22T22:18:07.741 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:07 +0000 (0:00:00.661) 0:03:24.238 ******* 2019-12-22T22:18:07.779 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-22T22:18:07.781 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi187"}, "changed": false} 2019-12-22T22:18:07.823 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:07 +0000 (0:00:00.077) 0:03:24.316 ******* 2019-12-22T22:18:07.988 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-22T22:18:08.016 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:08 +0000 (0:00:00.196) 0:03:24.513 ******* 2019-12-22T22:18:08.348 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi187.front.sepia.ceph.com", "ansible_hostname": "smithi187", "ansible_nodename": "smithi187"}, "changed": true, "name": "smithi187"} 2019-12-22T22:18:08.388 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:08 +0000 (0:00:00.372) 0:03:24.885 ******* 2019-12-22T22:18:08.917 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-22T22:18:08.919 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-22T22:18:08.969 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:08 +0000 (0:00:00.580) 0:03:25.466 ******* 2019-12-22T22:18:09.301 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-22T22:18:09.302 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-22T22:18:09.341 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:09 +0000 (0:00:00.371) 0:03:25.837 ******* 2019-12-22T22:18:09.875 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-22T22:18:09.876 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-22T22:18:09.922 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:09 +0000 (0:00:00.580) 0:03:26.418 ******* 2019-12-22T22:18:10.233 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-22T22:18:10.234 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-22T22:18:10.235 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-22T22:18:10.273 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:10 +0000 (0:00:00.351) 0:03:26.770 ******* 2019-12-22T22:18:10.324 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:10 +0000 (0:00:00.050) 0:03:26.821 ******* 2019-12-22T22:18:10.598 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-22T22:18:10.600 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-22T22:18:10.648 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:10 +0000 (0:00:00.323) 0:03:27.145 ******* 2019-12-22T22:18:11.017 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi168.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-22T22:18:11.056 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:11 +0000 (0:00:00.407) 0:03:27.553 ******* 2019-12-22T22:18:11.189 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-22T22:18:11.190 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-22T22:18:11.230 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:11 +0000 (0:00:00.174) 0:03:27.727 ******* 2019-12-22T22:18:12.019 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-22T22:18:12.057 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:12 +0000 (0:00:00.827) 0:03:28.554 ******* 2019-12-22T22:18:12.159 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-22T22:18:12.159 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-22T22:18:12.198 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:12 +0000 (0:00:00.140) 0:03:28.695 ******* 2019-12-22T22:18:12.536 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-22T22:18:12.577 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:12 +0000 (0:00:00.378) 0:03:29.073 ******* 2019-12-22T22:18:12.890 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-22T22:18:12.891 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-22T22:18:12.943 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:12 +0000 (0:00:00.365) 0:03:29.439 ******* 2019-12-22T22:18:13.023 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-22T22:18:13.024 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-22T22:18:13.077 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:13 +0000 (0:00:00.135) 0:03:29.574 ******* 2019-12-22T22:18:13.115 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-22T22:18:13.116 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.924960", "end": "2019-12-22 22:18:13.078516", "rc": 0, "start": "2019-12-22 22:18:05.153556", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:18:13.157 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:13 +0000 (0:00:00.078) 0:03:29.653 ******* 2019-12-22T22:18:13.295 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-22T22:18:13.296 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-22T22:18:13.338 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:13 +0000 (0:00:00.182) 0:03:29.835 ******* 2019-12-22T22:18:13.509 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-22T22:18:13.511 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-22T22:18:13.551 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:13 +0000 (0:00:00.213) 0:03:30.048 ******* 2019-12-22T22:18:13.590 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-22T22:18:13.591 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-22T22:18:13.634 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:13 +0000 (0:00:00.083) 0:03:30.131 ******* 2019-12-22T22:18:13.695 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-22T22:18:13.697 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-22T22:18:13.740 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:13 +0000 (0:00:00.105) 0:03:30.237 ******* 2019-12-22T22:18:13.741 INFO:teuthology.task.ansible.out: 2019-12-22T22:18:13.799 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN", "python3"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-22T22:18:13.857 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:13 +0000 (0:00:00.117) 0:03:30.354 ******* 2019-12-22T22:18:13.901 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-22T22:18:13.937 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:13 +0000 (0:00:00.080) 0:03:30.434 ******* 2019-12-22T22:18:13.939 INFO:teuthology.task.ansible.out: 2019-12-22T22:18:14.253 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-22T22:18:14.293 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:14 +0000 (0:00:00.355) 0:03:30.790 ******* 2019-12-22T22:18:14.303 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-22T22:18:14.303 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-22T22:18:14.346 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:14 +0000 (0:00:00.052) 0:03:30.843 ******* 2019-12-22T22:18:14.660 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-22T22:18:14.662 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-22T22:18:14.706 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:14 +0000 (0:00:00.360) 0:03:31.203 ******* 2019-12-22T22:18:14.734 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-22T22:18:14.736 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:14.790 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:14 +0000 (0:00:00.084) 0:03:31.287 ******* 2019-12-22T22:18:14.817 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-22T22:18:14.819 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:14.855 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:14 +0000 (0:00:00.064) 0:03:31.352 ******* 2019-12-22T22:18:15.217 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-22T22:18:15.219 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-22T22:18:15.255 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:15 +0000 (0:00:00.399) 0:03:31.752 ******* 2019-12-22T22:18:15.283 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-22T22:18:15.284 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-22T22:18:15.328 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:15 +0000 (0:00:00.073) 0:03:31.825 ******* 2019-12-22T22:18:15.552 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-22T22:18:15.553 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-12-22T22:18:15.554 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.149043", "end": "2019-12-22 22:18:15.520587", "rc": 0, "start": "2019-12-22 22:18:13.371544", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:18:15.600 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:15 +0000 (0:00:00.271) 0:03:32.097 ******* 2019-12-22T22:18:15.633 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-22T22:18:15.676 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:15 +0000 (0:00:00.076) 0:03:32.173 ******* 2019-12-22T22:18:16.249 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-22T22:18:16.250 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-22T22:18:16.293 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:16 +0000 (0:00:00.616) 0:03:32.790 ******* 2019-12-22T22:18:16.357 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-22T22:18:16.359 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi071"}, "changed": false} 2019-12-22T22:18:16.397 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:16 +0000 (0:00:00.103) 0:03:32.894 ******* 2019-12-22T22:18:16.640 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-22T22:18:16.641 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-22T22:18:16.971 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-22T22:18:16.972 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi071.front.sepia.ceph.com", "ansible_hostname": "smithi071", "ansible_nodename": "smithi071"}, "changed": true, "name": "smithi071"} 2019-12-22T22:18:17.011 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:17 +0000 (0:00:00.614) 0:03:33.508 ******* 2019-12-22T22:18:17.536 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-22T22:18:17.539 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-22T22:18:17.580 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:17 +0000 (0:00:00.569) 0:03:34.077 ******* 2019-12-22T22:18:17.607 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2019-12-22T22:18:17.647 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:17 +0000 (0:00:00.066) 0:03:34.144 ******* 2019-12-22T22:18:17.675 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-22T22:18:17.677 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:17.721 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:17 +0000 (0:00:00.074) 0:03:34.218 ******* 2019-12-22T22:18:17.758 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-22T22:18:17.760 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:18:17.770 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:18:17.817 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:17 +0000 (0:00:00.096) 0:03:34.314 ******* 2019-12-22T22:18:17.832 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-22T22:18:17.836 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.166884", "end": "2019-12-22 22:18:17.800842", "rc": 0, "start": "2019-12-22 22:18:15.633958", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:18:17.875 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:17 +0000 (0:00:00.057) 0:03:34.372 ******* 2019-12-22T22:18:17.881 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-22T22:18:17.882 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:17.932 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:17 +0000 (0:00:00.056) 0:03:34.428 ******* 2019-12-22T22:18:17.941 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-22T22:18:17.942 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-22T22:18:17.943 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-22T22:18:17.981 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:17 +0000 (0:00:00.049) 0:03:34.477 ******* 2019-12-22T22:18:18.020 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:18 +0000 (0:00:00.035) 0:03:34.513 ******* 2019-12-22T22:18:18.022 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:18:18.023 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-22T22:18:18.061 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:18 +0000 (0:00:00.044) 0:03:34.558 ******* 2019-12-22T22:18:18.557 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-22T22:18:18.558 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-22T22:18:18.597 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:18 +0000 (0:00:00.535) 0:03:35.094 ******* 2019-12-22T22:18:18.911 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-22T22:18:18.912 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-22T22:18:18.972 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:18 +0000 (0:00:00.375) 0:03:35.469 ******* 2019-12-22T22:18:18.991 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-22T22:18:18.993 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-22T22:18:19.255 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-22T22:18:19.257 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.300808", "end": "2019-12-22 22:18:19.220028", "rc": 0, "start": "2019-12-22 22:18:18.919220", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.umd.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.atlanticmetro.net\n * updates: repos-va.psychz.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.umd.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.atlanticmetro.net", " * updates: repos-va.psychz.net", "No unfinished transactions left."]} 2019-12-22T22:18:19.293 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:19 +0000 (0:00:00.320) 0:03:35.790 ******* 2019-12-22T22:18:19.647 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-22T22:18:19.648 INFO:teuthology.task.ansible.out:fatal: [smithi168.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.050327", "end": "2019-12-22 22:18:19.619460", "msg": "non-zero return code", "rc": 1, "start": "2019-12-22 22:18:19.569133", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-22T22:18:19.687 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:19 +0000 (0:00:00.394) 0:03:36.184 ******* 2019-12-22T22:18:19.717 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-22T22:18:19.719 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:19.756 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:19 +0000 (0:00:00.068) 0:03:36.252 ******* 2019-12-22T22:18:19.849 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-22T22:18:19.850 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-22T22:18:19.891 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:19 +0000 (0:00:00.135) 0:03:36.388 ******* 2019-12-22T22:18:19.898 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-22T22:18:19.899 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-22T22:18:19.969 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:19 +0000 (0:00:00.077) 0:03:36.465 ******* 2019-12-22T22:18:19.996 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2019-12-22T22:18:20.034 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:20 +0000 (0:00:00.066) 0:03:36.531 ******* 2019-12-22T22:18:20.061 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-22T22:18:20.063 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:20.101 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:20 +0000 (0:00:00.066) 0:03:36.598 ******* 2019-12-22T22:18:20.138 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-22T22:18:20.140 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:18:20.150 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:18:20.190 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:20 +0000 (0:00:00.089) 0:03:36.687 ******* 2019-12-22T22:18:20.229 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-22T22:18:20.231 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:20.273 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:20 +0000 (0:00:00.082) 0:03:36.770 ******* 2019-12-22T22:18:20.315 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:18:20.316 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-22T22:18:20.364 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:20 +0000 (0:00:00.091) 0:03:36.861 ******* 2019-12-22T22:18:20.757 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-22T22:18:20.759 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-22T22:18:20.799 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:20 +0000 (0:00:00.434) 0:03:37.296 ******* 2019-12-22T22:18:20.861 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-22T22:18:20.862 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-22T22:18:20.900 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:20 +0000 (0:00:00.100) 0:03:37.397 ******* 2019-12-22T22:18:21.129 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-22T22:18:21.130 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-22T22:18:21.192 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:21 +0000 (0:00:00.292) 0:03:37.689 ******* 2019-12-22T22:18:21.522 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-22T22:18:21.523 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.292654", "end": "2019-12-22 22:18:21.481967", "rc": 0, "start": "2019-12-22 22:18:21.189313", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.umd.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.fileplanet.com\n * updates: repos-va.psychz.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.umd.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.fileplanet.com", " * updates: repos-va.psychz.net", "No unfinished transactions left."]} 2019-12-22T22:18:21.560 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:21 +0000 (0:00:00.367) 0:03:38.057 ******* 2019-12-22T22:18:21.568 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-22T22:18:21.572 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-22T22:18:21.619 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:21 +0000 (0:00:00.058) 0:03:38.115 ******* 2019-12-22T22:18:21.930 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-22T22:18:21.931 INFO:teuthology.task.ansible.out:fatal: [smithi187.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.050865", "end": "2019-12-22 22:18:21.896435", "msg": "non-zero return code", "rc": 1, "start": "2019-12-22 22:18:21.845570", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-22T22:18:21.990 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:21 +0000 (0:00:00.371) 0:03:38.487 ******* 2019-12-22T22:18:21.998 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-22T22:18:21.999 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-22T22:18:22.040 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:22 +0000 (0:00:00.050) 0:03:38.537 ******* 2019-12-22T22:18:22.047 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-22T22:18:22.050 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:22.090 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:22 +0000 (0:00:00.049) 0:03:38.586 ******* 2019-12-22T22:18:22.958 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-22T22:18:23.000 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:22 +0000 (0:00:00.910) 0:03:39.497 ******* 2019-12-22T22:18:23.926 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-22T22:18:23.928 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-22T22:18:23.964 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:23 +0000 (0:00:00.963) 0:03:40.460 ******* 2019-12-22T22:18:26.403 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-22T22:18:26.404 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.113851", "end": "2019-12-22 22:18:26.378032", "rc": 0, "start": "2019-12-22 22:18:24.264181", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:18:26.446 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:26 +0000 (0:00:02.482) 0:03:42.943 ******* 2019-12-22T22:18:26.474 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-22T22:18:26.516 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:26 +0000 (0:00:00.069) 0:03:43.013 ******* 2019-12-22T22:18:27.468 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi071.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-22T22:18:28.146 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-22T22:18:28.148 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-22T22:18:28.150 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-22T22:18:28.151 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-22T22:18:28.186 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:28 +0000 (0:00:01.670) 0:03:44.683 ******* 2019-12-22T22:18:28.399 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-22T22:18:28.401 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-22T22:18:28.450 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:28 +0000 (0:00:00.263) 0:03:44.947 ******* 2019-12-22T22:18:28.489 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2019-12-22T22:18:28.543 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:28 +0000 (0:00:00.092) 0:03:45.040 ******* 2019-12-22T22:18:28.585 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-22T22:18:28.589 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:28.640 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:28 +0000 (0:00:00.096) 0:03:45.137 ******* 2019-12-22T22:18:28.682 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-22T22:18:28.684 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:18:28.694 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:18:28.743 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:28 +0000 (0:00:00.103) 0:03:45.240 ******* 2019-12-22T22:18:28.772 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-22T22:18:28.773 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:28.810 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:28 +0000 (0:00:00.066) 0:03:45.307 ******* 2019-12-22T22:18:28.849 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:18:28.851 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-22T22:18:28.890 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:28 +0000 (0:00:00.080) 0:03:45.387 ******* 2019-12-22T22:18:29.362 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-22T22:18:29.362 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-22T22:18:29.407 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:29 +0000 (0:00:00.510) 0:03:45.898 ******* 2019-12-22T22:18:30.095 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-22T22:18:30.097 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.328970", "end": "2019-12-22 22:18:30.061310", "rc": 0, "start": "2019-12-22 22:18:29.732340", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.umd.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.fileplanet.com\n * updates: repos-va.psychz.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.umd.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.fileplanet.com", " * updates: repos-va.psychz.net", "No unfinished transactions left."]} 2019-12-22T22:18:30.141 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:30 +0000 (0:00:00.739) 0:03:46.637 ******* 2019-12-22T22:18:30.512 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-22T22:18:30.513 INFO:teuthology.task.ansible.out:fatal: [smithi071.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.055660", "end": "2019-12-22 22:18:30.486595", "msg": "non-zero return code", "rc": 1, "start": "2019-12-22 22:18:30.430935", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-22T22:18:30.565 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:30 +0000 (0:00:00.424) 0:03:47.062 ******* 2019-12-22T22:18:30.615 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-22T22:18:30.617 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:30.674 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:30 +0000 (0:00:00.108) 0:03:47.171 ******* 2019-12-22T22:18:30.716 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-22T22:18:30.718 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-22T22:18:30.720 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-22T22:18:30.721 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-22T22:18:30.786 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:30 +0000 (0:00:00.112) 0:03:47.283 ******* 2019-12-22T22:18:31.588 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-22T22:18:31.589 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-22T22:18:31.663 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:31 +0000 (0:00:00.876) 0:03:48.160 ******* 2019-12-22T22:18:34.203 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-22T22:18:34.242 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:34 +0000 (0:00:02.579) 0:03:50.739 ******* 2019-12-22T22:18:38.896 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-22T22:18:38.897 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-22T22:18:38.899 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-22T22:18:38.900 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-22T22:18:38.945 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:38 +0000 (0:00:04.702) 0:03:55.442 ******* 2019-12-22T22:18:42.292 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-22T22:18:42.294 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-22T22:18:42.331 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:42 +0000 (0:00:03.385) 0:03:58.828 ******* 2019-12-22T22:18:54.706 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-22T22:18:54.710 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "python3"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-pro 2019-12-22T22:18:54.711 INFO:teuthology.task.ansible.out:gs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is al 2019-12-22T22:18:54.713 INFO:teuthology.task.ansible.out:ready installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.umd.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.atlanticmetro.net\n * updates: repos-va.psychz.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package python3.x86_64 0:3.6.8-10.el7 will be installed\n--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: lib 2019-12-22T22:18:54.714 INFO:teuthology.task.ansible.out:boost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed\n---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed\n---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n python3 x86_64 3.6.8-10.el7 base 69 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n python3-libs x86_64 3.6.8-10.el7 base 7.0 M\n python3-pip noarch 9.0.3-5.el7 base 1.8 M\n python3-setuptools noarch 39.2.0-10.el7 base 629 k\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n============================================================= 2019-12-22T22:18:54.716 INFO:teuthology.task.ansible.out:===================\nInstall 4 Packages (+8 Dependent packages)\n\nTotal download size: 18 M\nInstalled size: 70 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 32 MB/s | 18 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/12 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/12 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/12 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x 2019-12-22T22:18:54.716 INFO:teuthology.task.ansible.out:86_64 4/12 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/12 \n Installing : python3-libs-3.6.8-10.el7.x86_64 6/12 \n Installing : python3-setuptools-39.2.0-10.el7.noarch 7/12 \n Installing : python3-3.6.8-10.el7.x86_64 8/12 \n Installing : python3-pip-9.0.3-5.el7.noarch 9/12 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 10/12 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 11/12 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 12/12 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/12 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/12 \n Verifying : python3-pip-9.0.3-5.el7.noarch 3/12 \n Verifying : python3-libs-3.6.8-10.el7.x86_64 4/12 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/12 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 6/12 \n Verifying : python3-setuptools-39.2.0-10.el7.noarch 7/12 \n Verifying : 10:qemu-img-1.5.3-167 2019-12-22T22:18:54.718 INFO:teuthology.task.ansible.out:.el7_7.1.x86_64 8/12 \n Verifying : boost-random-1.53.0-27.el7.x86_64 9/12 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 10/12 \n Verifying : python3-3.6.8-10.el7.x86_64 11/12 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 12/12 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n python3.x86_64 0:3.6.8-10.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n python3-libs.x86_64 0:3.6.8-10.el7 \n python3-pip.noarch 0:9.0.3-5.el7 \n python3-setuptools.noarch 0:39.2.0-10.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-22T22:18:54.755 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:54 +0000 (0:00:12.423) 0:04:11.252 ******* 2019-12-22T22:18:55.573 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-22T22:18:55.575 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-22T22:18:55.610 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:55 +0000 (0:00:00.854) 0:04:12.107 ******* 2019-12-22T22:18:56.178 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-22T22:18:56.179 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-22T22:18:56.228 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:56 +0000 (0:00:00.618) 0:04:12.725 ******* 2019-12-22T22:18:56.271 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:56.311 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:56 +0000 (0:00:00.082) 0:04:12.808 ******* 2019-12-22T22:18:56.790 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-22T22:18:56.794 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service dbus.service system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ip6tables.service iptables.service ebtables.service ipset.service shutdown.t 2019-12-22T22:18:56.796 INFO:teuthology.task.ansible.out:arget", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMS 2019-12-22T22:18:56.798 INFO:teuthology.task.ansible.out:coreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-22T22:18:56.848 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:56 +0000 (0:00:00.537) 0:04:13.345 ******* 2019-12-22T22:18:57.255 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-22T22:18:57.256 INFO:teuthology.task.ansible.out:fatal: [smithi168.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-22T22:18:57.305 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:57 +0000 (0:00:00.456) 0:04:13.802 ******* 2019-12-22T22:18:57.758 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-22T22:18:57.760 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "python3"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-pro 2019-12-22T22:18:57.762 INFO:teuthology.task.ansible.out:gs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is al 2019-12-22T22:18:57.763 INFO:teuthology.task.ansible.out:ready installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.umd.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.fileplanet.com\n * updates: repos-va.psychz.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package python3.x86_64 0:3.6.8-10.el7 will be installed\n--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboo 2019-12-22T22:18:57.767 INFO:teuthology.task.ansible.out:st_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed\n---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed\n---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n python3 x86_64 3.6.8-10.el7 base 69 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n python3-libs x86_64 3.6.8-10.el7 base 7.0 M\n python3-pip noarch 9.0.3-5.el7 base 1.8 M\n python3-setuptools noarch 39.2.0-10.el7 base 629 k\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================ 2019-12-22T22:18:57.769 INFO:teuthology.task.ansible.out:================\nInstall 4 Packages (+8 Dependent packages)\n\nTotal download size: 18 M\nInstalled size: 70 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 29 MB/s | 18 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/12 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/12 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/12 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/12 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/12 \n Installing : python3-libs-3.6.8-10.el7.x86_64 6/12 \n Installing : python3-setuptools-39.2.0-10.el7.noarch 7/12 \n Installing : python3-3.6.8-10.el7.x86_64 8/12 \n Installing : python3-pip-9.0.3-5.el7.noarch 9/12 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 10/12 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 11/12 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 12/12 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/12 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/12 \n Verifying : python3-pip-9.0.3-5.el7.noarch 3/12 \n Verifying : python3-libs-3.6.8-10.el7.x86_64 4/12 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/12 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 6/12 \n Verifying : python3-setuptools-39.2.0-10.el7.noarch 7/12 \n Verifying : 10:qemu-img-1.5.3-167.el 2019-12-22T22:18:57.770 INFO:teuthology.task.ansible.out:7_7.1.x86_64 8/12 \n Verifying : boost-random-1.53.0-27.el7.x86_64 9/12 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 10/12 \n Verifying : python3-3.6.8-10.el7.x86_64 11/12 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 12/12 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n python3.x86_64 0:3.6.8-10.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n python3-libs.x86_64 0:3.6.8-10.el7 \n python3-pip.noarch 0:9.0.3-5.el7 \n python3-setuptools.noarch 0:39.2.0-10.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-22T22:18:57.801 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:57 +0000 (0:00:00.496) 0:04:14.298 ******* 2019-12-22T22:18:58.206 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-22T22:18:58.207 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-22T22:18:58.264 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.462) 0:04:14.761 ******* 2019-12-22T22:18:58.294 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-22T22:18:58.296 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:58.351 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.086) 0:04:14.848 ******* 2019-12-22T22:18:58.391 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-22T22:18:58.441 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.089) 0:04:14.937 ******* 2019-12-22T22:18:58.471 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:58.525 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.084) 0:04:15.022 ******* 2019-12-22T22:18:58.555 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-22T22:18:58.556 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-22T22:18:58.558 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-22T22:18:58.559 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:58.597 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.071) 0:04:15.094 ******* 2019-12-22T22:18:58.641 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.041) 0:04:15.135 ******* 2019-12-22T22:18:58.644 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-22T22:18:58.646 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:18:58.701 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.062) 0:04:15.198 ******* 2019-12-22T22:18:58.730 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-22T22:18:58.732 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:58.769 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.067) 0:04:15.265 ******* 2019-12-22T22:18:58.808 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-22T22:18:58.853 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.084) 0:04:15.350 ******* 2019-12-22T22:18:58.892 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-22T22:18:58.894 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:58.939 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:58 +0000 (0:00:00.086) 0:04:15.436 ******* 2019-12-22T22:18:58.968 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.011 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.071) 0:04:15.508 ******* 2019-12-22T22:18:59.040 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-22T22:18:59.041 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.077 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.065) 0:04:15.573 ******* 2019-12-22T22:18:59.103 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-22T22:18:59.105 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.141 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.064) 0:04:15.638 ******* 2019-12-22T22:18:59.168 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-22T22:18:59.170 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-22T22:18:59.209 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.067) 0:04:15.705 ******* 2019-12-22T22:18:59.245 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.036) 0:04:15.742 ******* 2019-12-22T22:18:59.251 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-22T22:18:59.253 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.293 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.047) 0:04:15.790 ******* 2019-12-22T22:18:59.299 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-22T22:18:59.301 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.341 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.048) 0:04:15.838 ******* 2019-12-22T22:18:59.347 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-22T22:18:59.349 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.387 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.045) 0:04:15.884 ******* 2019-12-22T22:18:59.416 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-22T22:18:59.417 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.453 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.065) 0:04:15.950 ******* 2019-12-22T22:18:59.484 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-22T22:18:59.486 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.526 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.073) 0:04:16.023 ******* 2019-12-22T22:18:59.574 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-22T22:18:59.576 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.612 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.085) 0:04:16.109 ******* 2019-12-22T22:18:59.662 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-22T22:18:59.663 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.700 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.087) 0:04:16.197 ******* 2019-12-22T22:18:59.728 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-22T22:18:59.730 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.779 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.078) 0:04:16.275 ******* 2019-12-22T22:18:59.791 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-22T22:18:59.795 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target system.slice dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service ebtables.service ip6tables.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-22T22:18:59.796 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-22T22:18:59.798 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-22T22:18:59.840 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.061) 0:04:16.337 ******* 2019-12-22T22:18:59.846 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-22T22:18:59.847 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.885 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.045) 0:04:16.382 ******* 2019-12-22T22:18:59.924 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-22T22:18:59.925 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:18:59.964 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:18:59 +0000 (0:00:00.078) 0:04:16.461 ******* 2019-12-22T22:19:00.002 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-22T22:19:00.004 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.041 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.076) 0:04:16.538 ******* 2019-12-22T22:19:00.079 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-22T22:19:00.081 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.130 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.089) 0:04:16.627 ******* 2019-12-22T22:19:00.166 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.202 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.071) 0:04:16.698 ******* 2019-12-22T22:19:00.230 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-22T22:19:00.231 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.285 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.083) 0:04:16.782 ******* 2019-12-22T22:19:00.298 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi187.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-22T22:19:00.339 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.054) 0:04:16.836 ******* 2019-12-22T22:19:00.346 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-22T22:19:00.347 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.397 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.057) 0:04:16.894 ******* 2019-12-22T22:19:00.424 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-22T22:19:00.427 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.466 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.069) 0:04:16.963 ******* 2019-12-22T22:19:00.504 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-22T22:19:00.506 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.545 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.078) 0:04:17.042 ******* 2019-12-22T22:19:00.593 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-22T22:19:00.595 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.633 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.087) 0:04:17.130 ******* 2019-12-22T22:19:00.670 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-22T22:19:00.672 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.710 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.075) 0:04:17.205 ******* 2019-12-22T22:19:00.740 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} TASK [testnode : Install packages] ********************************************* skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.776 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.067) 0:04:17.273 ******* 2019-12-22T22:19:00.813 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.037) 0:04:17.310 ******* 2019-12-22T22:19:00.819 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-22T22:19:00.821 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.871 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.057) 0:04:17.368 ******* 2019-12-22T22:19:00.877 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-22T22:19:00.879 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.922 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.050) 0:04:17.418 ******* 2019-12-22T22:19:00.928 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-22T22:19:00.929 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:00.979 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:00 +0000 (0:00:00.057) 0:04:17.476 ******* 2019-12-22T22:19:00.989 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-22T22:19:01.031 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.051) 0:04:17.527 ******* 2019-12-22T22:19:01.059 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-22T22:19:01.061 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.100 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.068) 0:04:17.596 ******* 2019-12-22T22:19:01.137 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.182 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.082) 0:04:17.679 ******* 2019-12-22T22:19:01.220 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-22T22:19:01.222 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.245 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.289 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.106) 0:04:17.786 ******* 2019-12-22T22:19:01.303 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-22T22:19:01.303 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-22T22:19:01.342 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.052) 0:04:17.839 ******* 2019-12-22T22:19:01.348 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-22T22:19:01.350 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.387 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.045) 0:04:17.884 ******* 2019-12-22T22:19:01.435 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-22T22:19:01.479 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.091) 0:04:17.976 ******* 2019-12-22T22:19:01.517 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-22T22:19:01.518 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.585 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.105) 0:04:18.082 ******* 2019-12-22T22:19:01.626 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-22T22:19:01.628 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.670 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.084) 0:04:18.167 ******* 2019-12-22T22:19:01.699 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-22T22:19:01.700 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-22T22:19:01.705 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.739 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.069) 0:04:18.236 ******* 2019-12-22T22:19:01.774 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.035) 0:04:18.271 ******* 2019-12-22T22:19:01.828 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.870 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.096) 0:04:18.367 ******* 2019-12-22T22:19:01.899 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-22T22:19:01.912 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:01.953 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:01 +0000 (0:00:00.082) 0:04:18.450 ******* 2019-12-22T22:19:01.983 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-22T22:19:01.985 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.025 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.071) 0:04:18.521 ******* 2019-12-22T22:19:02.052 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-22T22:19:02.054 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.092 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.067) 0:04:18.589 ******* 2019-12-22T22:19:02.103 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-22T22:19:02.150 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.057) 0:04:18.647 ******* 2019-12-22T22:19:02.156 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-22T22:19:02.157 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.197 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.047) 0:04:18.694 ******* 2019-12-22T22:19:02.205 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-22T22:19:02.205 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.247 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.049) 0:04:18.744 ******* 2019-12-22T22:19:02.255 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-22T22:19:02.256 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.297 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.050) 0:04:18.794 ******* 2019-12-22T22:19:02.303 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-22T22:19:02.306 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.348 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.050) 0:04:18.845 ******* 2019-12-22T22:19:02.355 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-22T22:19:02.355 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.395 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.046) 0:04:18.892 ******* 2019-12-22T22:19:02.403 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-22T22:19:02.404 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.446 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.050) 0:04:18.943 ******* 2019-12-22T22:19:02.454 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.496 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.049) 0:04:18.992 ******* 2019-12-22T22:19:02.502 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-22T22:19:02.503 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.541 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.045) 0:04:19.038 ******* 2019-12-22T22:19:02.551 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-22T22:19:02.552 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.590 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.049) 0:04:19.087 ******* 2019-12-22T22:19:02.596 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-22T22:19:02.597 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.637 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.046) 0:04:19.134 ******* 2019-12-22T22:19:02.644 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-22T22:19:02.645 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.687 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.050) 0:04:19.184 ******* 2019-12-22T22:19:02.697 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.734 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.046) 0:04:19.231 ******* 2019-12-22T22:19:02.740 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-22T22:19:02.741 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.781 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.047) 0:04:19.278 ******* 2019-12-22T22:19:02.787 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-22T22:19:02.790 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.827 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.046) 0:04:19.324 ******* 2019-12-22T22:19:02.834 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-22T22:19:02.836 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.874 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.046) 0:04:19.371 ******* 2019-12-22T22:19:02.882 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-22T22:19:02.884 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.922 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.048) 0:04:19.419 ******* 2019-12-22T22:19:02.928 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-22T22:19:02.929 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:02.971 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:02 +0000 (0:00:00.048) 0:04:19.468 ******* 2019-12-22T22:19:02.976 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-22T22:19:02.978 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.033 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.062) 0:04:19.530 ******* 2019-12-22T22:19:03.042 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-22T22:19:03.044 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.085 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.051) 0:04:19.582 ******* 2019-12-22T22:19:03.091 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-22T22:19:03.091 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.133 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.047) 0:04:19.630 ******* 2019-12-22T22:19:03.139 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-22T22:19:03.141 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.184 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.050) 0:04:19.681 ******* 2019-12-22T22:19:03.190 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-22T22:19:03.190 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.233 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.049) 0:04:19.730 ******* 2019-12-22T22:19:03.239 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-22T22:19:03.240 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.279 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.045) 0:04:19.776 ******* 2019-12-22T22:19:03.284 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-22T22:19:03.285 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.325 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.045) 0:04:19.822 ******* 2019-12-22T22:19:03.331 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-22T22:19:03.332 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.374 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.049) 0:04:19.871 ******* 2019-12-22T22:19:03.380 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-22T22:19:03.383 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.421 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.046) 0:04:19.918 ******* 2019-12-22T22:19:03.428 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-22T22:19:03.429 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.467 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.045) 0:04:19.964 ******* 2019-12-22T22:19:03.473 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-22T22:19:03.475 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.516 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.048) 0:04:20.013 ******* 2019-12-22T22:19:03.523 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-22T22:19:03.524 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.564 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.048) 0:04:20.061 ******* 2019-12-22T22:19:03.570 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-22T22:19:03.572 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.610 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.045) 0:04:20.106 ******* 2019-12-22T22:19:03.619 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-22T22:19:03.621 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.660 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.047) 0:04:20.154 ******* 2019-12-22T22:19:03.663 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-22T22:19:03.665 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.704 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.047) 0:04:20.201 ******* 2019-12-22T22:19:03.711 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-22T22:19:03.713 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.752 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.047) 0:04:20.248 ******* 2019-12-22T22:19:03.758 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-22T22:19:03.760 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.797 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.045) 0:04:20.294 ******* 2019-12-22T22:19:03.803 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-22T22:19:03.805 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.847 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.050) 0:04:20.344 ******* 2019-12-22T22:19:03.856 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-22T22:19:03.857 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.897 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.048) 0:04:20.392 ******* 2019-12-22T22:19:03.905 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.942 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.046) 0:04:20.439 ******* 2019-12-22T22:19:03.948 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-22T22:19:03.948 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:03.989 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:03 +0000 (0:00:00.047) 0:04:20.486 ******* 2019-12-22T22:19:04.028 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-22T22:19:04.030 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.065 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.076) 0:04:20.562 ******* 2019-12-22T22:19:04.093 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-22T22:19:04.095 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.130 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.064) 0:04:20.627 ******* 2019-12-22T22:19:04.161 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-22T22:19:04.163 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.214 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.083) 0:04:20.711 ******* 2019-12-22T22:19:04.257 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-22T22:19:04.259 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:04.259 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-22T22:19:04.302 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.088) 0:04:20.799 ******* 2019-12-22T22:19:04.343 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.038) 0:04:20.839 ******* 2019-12-22T22:19:04.348 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-22T22:19:04.350 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.372 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-22T22:19:04.383 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.385 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.394 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.405 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.416 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.465 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.118) 0:04:20.958 ******* 2019-12-22T22:19:04.637 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-22T22:19:04.639 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004667", "end": "2019-12-22 22:19:04.616663", "rc": 0, "start": "2019-12-22 22:19:04.611996", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-22T22:19:04.692 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.230) 0:04:21.188 ******* 2019-12-22T22:19:04.698 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-22T22:19:04.699 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-22T22:19:04.742 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.050) 0:04:21.239 ******* 2019-12-22T22:19:04.750 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-22T22:19:04.751 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.796 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.053) 0:04:21.293 ******* 2019-12-22T22:19:04.847 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-22T22:19:04.848 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.896 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.099) 0:04:21.392 ******* 2019-12-22T22:19:04.935 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-22T22:19:04.937 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:04.978 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:04 +0000 (0:00:00.082) 0:04:21.475 ******* 2019-12-22T22:19:05.018 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-22T22:19:05.019 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.059 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.081) 0:04:21.556 ******* 2019-12-22T22:19:05.079 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-22T22:19:05.080 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-22T22:19:05.131 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.068) 0:04:21.625 ******* 2019-12-22T22:19:05.169 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-22T22:19:05.171 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.207 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.079) 0:04:21.704 ******* 2019-12-22T22:19:05.234 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-22T22:19:05.236 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.274 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.066) 0:04:21.771 ******* 2019-12-22T22:19:05.313 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.351 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.077) 0:04:21.848 ******* 2019-12-22T22:19:05.380 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-22T22:19:05.385 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "python3"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-pro 2019-12-22T22:19:05.393 INFO:teuthology.task.ansible.out:gs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is al 2019-12-22T22:19:05.394 INFO:teuthology.task.ansible.out:ready installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.umd.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.fileplanet.com\n * updates: repos-va.psychz.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package python3.x86_64 0:3.6.8-10.el7 will be installed\n--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64\n--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboo 2019-12-22T22:19:05.396 INFO:teuthology.task.ansible.out:st_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed\n---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed\n---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n python3 x86_64 3.6.8-10.el7 base 69 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n python3-libs x86_64 3.6.8-10.el7 base 7.0 M\n python3-pip noarch 9.0.3-5.el7 base 1.8 M\n python3-setuptools noarch 39.2.0-10.el7 base 629 k\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================ 2019-12-22T22:19:05.397 INFO:teuthology.task.ansible.out:================\nInstall 4 Packages (+8 Dependent packages)\n\nTotal download size: 18 M\nInstalled size: 70 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 40 MB/s | 18 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/12 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/12 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/12 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/12 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/12 \n Installing : python3-libs-3.6.8-10.el7.x86_64 6/12 \n Installing : python3-setuptools-39.2.0-10.el7.noarch 7/12 \n Installing : python3-3.6.8-10.el7.x86_64 8/12 \n Installing : python3-pip-9.0.3-5.el7.noarch 9/12 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 10/12 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 11/12 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 12/12 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/12 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/12 \n Verifying : python3-pip-9.0.3-5.el7.noarch 3/12 \n Verifying : python3-libs-3.6.8-10.el7.x86_64 4/12 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 5/12 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 6/12 \n Verifying : python3-setuptools-39.2.0-10.el7.noarch 7/12 \n Verifying : 10:qemu-img-1.5.3-167.el 2019-12-22T22:19:05.399 INFO:teuthology.task.ansible.out:7_7.1.x86_64 8/12 \n Verifying : boost-random-1.53.0-27.el7.x86_64 9/12 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 10/12 \n Verifying : python3-3.6.8-10.el7.x86_64 11/12 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 12/12 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7- 2019-12-22T22:19:05.399 INFO:teuthology.task.ansible.out:1.ceph.el7.centos \n python3.x86_64 0:3.6.8-10.el7 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n python3-libs.x86_64 0:3.6.8-10.el7 \n python3-pip.noarch 0:9.0.3-5.el7 \n python3-setuptools.noarch 0:39.2.0-10.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-22T22:19:05.401 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-22T22:19:05.402 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.439 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.087) 0:04:21.936 ******* 2019-12-22T22:19:05.476 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.037) 0:04:21.973 ******* 2019-12-22T22:19:05.517 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-22T22:19:05.518 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.559 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.082) 0:04:22.056 ******* 2019-12-22T22:19:05.566 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-22T22:19:05.567 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-22T22:19:05.615 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.056) 0:04:22.112 ******* 2019-12-22T22:19:05.629 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-22T22:19:05.630 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.685 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.069) 0:04:22.182 ******* 2019-12-22T22:19:05.692 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-22T22:19:05.693 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item={u'block_used': 13037652, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286832, u'size_available': 930966863872, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966956, u'device': u'/dev/sda1', u'inode_used': 88020, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286832, "block_size": 4096, "block_total": 240324484, "block_used": 13037652, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966956, "inode_total": 61054976, "inode_used": 88020, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966863872, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-22T22:19:05.744 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.058) 0:04:22.240 ******* 2019-12-22T22:19:05.750 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-22T22:19:05.752 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.790 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.046) 0:04:22.287 ******* 2019-12-22T22:19:05.817 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-22T22:19:05.820 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.857 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.066) 0:04:22.354 ******* 2019-12-22T22:19:05.884 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-22T22:19:05.886 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:05.938 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:05 +0000 (0:00:00.081) 0:04:22.435 ******* 2019-12-22T22:19:05.965 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-22T22:19:05.966 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.021 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.082) 0:04:22.518 ******* 2019-12-22T22:19:06.049 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-22T22:19:06.050 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.094 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.072) 0:04:22.591 ******* 2019-12-22T22:19:06.105 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-22T22:19:06.106 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011769", "end": "2019-12-22 22:19:06.076619", "rc": 0, "start": "2019-12-22 22:19:06.064850", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:06.153 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.058) 0:04:22.649 ******* 2019-12-22T22:19:06.159 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-22T22:19:06.160 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.202 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.049) 0:04:22.699 ******* 2019-12-22T22:19:06.208 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-22T22:19:06.209 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'block_used': 13037652, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286832, u'size_available': 930966863872, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966956, u'device': u'/dev/sda1', u'inode_used': 88020, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286832, "block_size": 4096, "block_total": 240324484, "block_used": 13037652, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966956, "inode_total": 61054976, "inode_used": 88020, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966863872, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.210 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-22T22:19:06.211 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-22T22:19:06.250 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.047) 0:04:22.747 ******* 2019-12-22T22:19:06.284 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.034) 0:04:22.781 ******* 2019-12-22T22:19:06.291 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-22T22:19:06.293 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.331 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.046) 0:04:22.828 ******* 2019-12-22T22:19:06.337 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-22T22:19:06.378 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.046) 0:04:22.875 ******* 2019-12-22T22:19:06.384 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-22T22:19:06.388 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.427 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.048) 0:04:22.924 ******* 2019-12-22T22:19:06.433 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:06.435 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFGH', u'wwn-0x5000c50092924459'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFGH', u'wwn': u'0x5000c50092924459', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFGH-part1', u'wwn-0x5000c50092924459-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFGH", "wwn-0x5000c50092924459"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFGH-part1", "wwn-0x5000c50092924459-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFGH", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-22T22:19:06.437 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092924459"}}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.458 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-22T22:19:06.460 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.515 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.087) 0:04:23.011 ******* 2019-12-22T22:19:06.552 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-22T22:19:06.554 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.597 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.082) 0:04:23.094 ******* 2019-12-22T22:19:06.624 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-22T22:19:06.626 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.662 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.064) 0:04:23.159 ******* 2019-12-22T22:19:06.688 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-22T22:19:06.690 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.726 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.064) 0:04:23.223 ******* 2019-12-22T22:19:06.754 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-22T22:19:06.756 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.791 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.065) 0:04:23.288 ******* 2019-12-22T22:19:06.797 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-22T22:19:06.798 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-22T22:19:06.837 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.045) 0:04:23.334 ******* 2019-12-22T22:19:06.843 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-22T22:19:06.845 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.889 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.051) 0:04:23.386 ******* 2019-12-22T22:19:06.894 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-22T22:19:06.895 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.933 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.044) 0:04:23.430 ******* 2019-12-22T22:19:06.940 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-22T22:19:06.941 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:06.981 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:06 +0000 (0:00:00.047) 0:04:23.478 ******* 2019-12-22T22:19:07.018 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-22T22:19:07.020 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.056 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.074) 0:04:23.553 ******* 2019-12-22T22:19:07.094 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:07.095 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-22T22:19:07.131 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.074) 0:04:23.628 ******* 2019-12-22T22:19:07.179 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-22T22:19:07.181 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.192 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-22T22:19:07.203 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.205 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.215 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.226 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.227 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.269 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.137) 0:04:23.766 ******* 2019-12-22T22:19:07.371 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-22T22:19:07.373 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target dbus.service system.slice polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "shutdown.target ip6tables.service ebtables.service iptables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-22T22:19:07.374 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-22T22:19:07.376 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-22T22:19:07.414 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.144) 0:04:23.911 ******* 2019-12-22T22:19:07.434 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-22T22:19:07.435 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003895", "end": "2019-12-22 22:19:07.409727", "rc": 0, "start": "2019-12-22 22:19:07.405832", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-22T22:19:07.479 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.065) 0:04:23.976 ******* 2019-12-22T22:19:07.517 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-22T22:19:07.519 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.567 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.087) 0:04:24.064 ******* 2019-12-22T22:19:07.605 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-22T22:19:07.607 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.657 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.089) 0:04:24.153 ******* 2019-12-22T22:19:07.684 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-22T22:19:07.686 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.728 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.071) 0:04:24.225 ******* 2019-12-22T22:19:07.758 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-22T22:19:07.761 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:07.799 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.070) 0:04:24.296 ******* 2019-12-22T22:19:07.848 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi071.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-22T22:19:07.916 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:07 +0000 (0:00:00.116) 0:04:24.413 ******* 2019-12-22T22:19:08.306 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-22T22:19:08.349 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.433) 0:04:24.846 ******* 2019-12-22T22:19:08.366 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-22T22:19:08.367 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-22T22:19:08.416 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.067) 0:04:24.913 ******* 2019-12-22T22:19:08.423 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-22T22:19:08.424 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:08.464 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.047) 0:04:24.961 ******* 2019-12-22T22:19:08.471 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-22T22:19:08.472 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item={u'block_used': 13037565, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286919, u'size_available': 930967220224, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966956, u'device': u'/dev/sda1', u'inode_used': 88020, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286919, "block_size": 4096, "block_total": 240324484, "block_used": 13037565, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966956, "inode_total": 61054976, "inode_used": 88020, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967220224, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-22T22:19:08.513 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.048) 0:04:25.010 ******* 2019-12-22T22:19:08.519 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-22T22:19:08.558 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.045) 0:04:25.055 ******* 2019-12-22T22:19:08.585 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-22T22:19:08.587 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:08.625 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.067) 0:04:25.122 ******* 2019-12-22T22:19:08.652 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-22T22:19:08.654 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:08.688 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.062) 0:04:25.185 ******* 2019-12-22T22:19:08.727 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-22T22:19:08.728 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:08.729 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:08.771 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.082) 0:04:25.268 ******* 2019-12-22T22:19:08.779 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:08.782 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-iccw3H-3tCI-t8ai-B3OF-tmN2-qBjb-AkgmGY', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300KZ400BGN', u'nvme-nvme.8086-435646543632333330304b5a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:02.002585", "end": "2019-12-22 22:19:08.709900", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-iccw3H-3tCI-t8ai-B3OF-tmN2-qBjb-AkgmGY", "nvme-INTEL_SSDPEDMD400G4_CVFT623300KZ400BGN", "nvme-nvme.8086-435646543632333330304b5a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:06.707 2019-12-22T22:19:08.784 INFO:teuthology.task.ansible.out:315", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:08.806 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-22T22:19:08.807 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:08.844 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.072) 0:04:25.341 ******* 2019-12-22T22:19:08.852 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-22T22:19:08.853 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011794", "end": "2019-12-22 22:19:08.806406", "rc": 0, "start": "2019-12-22 22:19:08.794612", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:08.892 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.047) 0:04:25.389 ******* 2019-12-22T22:19:08.898 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-22T22:19:08.952 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.059) 0:04:25.449 ******* 2019-12-22T22:19:08.958 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-22T22:19:08.959 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'block_used': 13037565, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286919, u'size_available': 930967220224, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966956, u'device': u'/dev/sda1', u'inode_used': 88020, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286919, "block_size": 4096, "block_total": 240324484, "block_used": 13037565, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966956, "inode_total": 61054976, "inode_used": 88020, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967220224, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:08.999 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:08 +0000 (0:00:00.046) 0:04:25.496 ******* 2019-12-22T22:19:09.004 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-22T22:19:09.006 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.044 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.044) 0:04:25.540 ******* 2019-12-22T22:19:09.050 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-22T22:19:09.095 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.051) 0:04:25.592 ******* 2019-12-22T22:19:09.101 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-22T22:19:09.103 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.143 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.047) 0:04:25.640 ******* 2019-12-22T22:19:09.150 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:09.151 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFQE', u'wwn-0x5000c5009292232d'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFQE', u'wwn': u'0x5000c5009292232d', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFQE-part1', u'wwn-0x5000c5009292232d-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFQE", "wwn-0x5000c5009292232d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFQE-part1", "wwn-0x5000c5009292232d-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFQE", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-22T22:19:09.153 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c5009292232d"}}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.174 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-22T22:19:09.176 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.211 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.068) 0:04:25.708 ******* 2019-12-22T22:19:09.252 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-22T22:19:09.254 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.288 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.077) 0:04:25.785 ******* 2019-12-22T22:19:09.316 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-22T22:19:09.318 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.356 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.067) 0:04:25.853 ******* 2019-12-22T22:19:09.384 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-22T22:19:09.386 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.425 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.068) 0:04:25.922 ******* 2019-12-22T22:19:09.464 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-22T22:19:09.466 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.501 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.075) 0:04:25.998 ******* 2019-12-22T22:19:09.530 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-22T22:19:09.532 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.567 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.065) 0:04:26.063 ******* 2019-12-22T22:19:09.594 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-22T22:19:09.596 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.632 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.065) 0:04:26.129 ******* 2019-12-22T22:19:09.659 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-22T22:19:09.661 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.714 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.081) 0:04:26.211 ******* 2019-12-22T22:19:09.745 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-22T22:19:09.747 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.808 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.094) 0:04:26.305 ******* 2019-12-22T22:19:09.835 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-22T22:19:09.836 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.874 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.065) 0:04:26.371 ******* 2019-12-22T22:19:09.901 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-22T22:19:09.903 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:09.939 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.064) 0:04:26.436 ******* 2019-12-22T22:19:09.966 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-22T22:19:09.968 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.004 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:09 +0000 (0:00:00.065) 0:04:26.501 ******* 2019-12-22T22:19:10.031 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-22T22:19:10.033 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.069 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.064) 0:04:26.566 ******* 2019-12-22T22:19:10.095 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-22T22:19:10.097 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.132 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.063) 0:04:26.629 ******* 2019-12-22T22:19:10.159 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-22T22:19:10.161 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.196 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.063) 0:04:26.693 ******* 2019-12-22T22:19:10.215 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:10.217 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjWUXQWhncf0R6fnCq0zdla4yg1YeMcDux'], u'uuids': [u'2b479011-7ab4-41ab-a8a9-bba464f281c6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.110466", "end": "2019-12-22 22:19:10.176104", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjWUXQWhncf0R6fnCq0zdla4yg1YeMcDux"], "labels": [], "masters": [], "uuids": ["2b479011-7ab4-41ab-a8a9-bba464f281c6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:09.065638", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:10.222 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-22T22:19:10.223 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.284 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.087) 0:04:26.781 ******* 2019-12-22T22:19:10.327 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-22T22:19:10.329 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.381 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.096) 0:04:26.878 ******* 2019-12-22T22:19:10.415 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-22T22:19:10.417 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.462 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.080) 0:04:26.959 ******* 2019-12-22T22:19:10.501 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-22T22:19:10.503 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.562 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.100) 0:04:27.059 ******* 2019-12-22T22:19:10.591 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-22T22:19:10.593 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.636 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.073) 0:04:27.133 ******* 2019-12-22T22:19:10.674 INFO:teuthology.task.ansible.out: 2019-12-22T22:19:10.675 INFO:teuthology.task.ansible.out:TASK [testnode : Remove packages] ********************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.713 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.077) 0:04:27.210 ******* 2019-12-22T22:19:10.752 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-22T22:19:10.754 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.802 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.088) 0:04:27.299 ******* 2019-12-22T22:19:10.842 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-22T22:19:10.844 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.892 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.090) 0:04:27.389 ******* 2019-12-22T22:19:10.931 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-22T22:19:10.938 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:10.974 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:10 +0000 (0:00:00.081) 0:04:27.471 ******* 2019-12-22T22:19:11.293 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-22T22:19:11.294 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-22T22:19:11.345 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:11 +0000 (0:00:00.371) 0:04:27.842 ******* 2019-12-22T22:19:11.509 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:11.510 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-cZ6ihO-fZ2z-CYtB-igBz-O9Ux-qfCL-SYF0j0', u'nvme-INTEL_SSDPEDMD400G4_PHFT620500MW400BGN', u'nvme-nvme.8086-504846543632303530304d5734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:02.072939", "end": "2019-12-22 22:19:11.461244", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-cZ6ihO-fZ2z-CYtB-igBz-O9Ux-qfCL-SYF0j0", "nvme-INTEL_SSDPEDMD400G4_PHFT620500MW400BGN", "nvme-nvme.8086-504846543632303530304d5734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:09.388 2019-12-22T22:19:11.512 INFO:teuthology.task.ansible.out:305", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:11.620 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjnWc36W2yNozeszuXbfLwX49RfGUOT7vS'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.074020", "end": "2019-12-22 22:19:11.580238", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjnWc36W2yNozeszuXbfLwX49RfGUOT7vS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:10.506218", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:11.682 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-22T22:19:11.684 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-22T22:19:11.747 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:11 +0000 (0:00:00.401) 0:04:28.243 ******* 2019-12-22T22:19:12.081 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-22T22:19:12.082 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-22T22:19:12.120 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.373) 0:04:28.617 ******* 2019-12-22T22:19:12.159 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-22T22:19:12.161 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.200 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.079) 0:04:28.696 ******* 2019-12-22T22:19:12.230 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-22T22:19:12.232 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.286 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.086) 0:04:28.783 ******* 2019-12-22T22:19:12.316 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-22T22:19:12.317 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.360 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.073) 0:04:28.857 ******* 2019-12-22T22:19:12.387 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-22T22:19:12.389 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.425 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.065) 0:04:28.922 ******* 2019-12-22T22:19:12.454 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-22T22:19:12.456 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.492 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.066) 0:04:28.989 ******* 2019-12-22T22:19:12.521 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-22T22:19:12.523 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.562 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.069) 0:04:29.059 ******* 2019-12-22T22:19:12.589 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-22T22:19:12.591 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.630 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.067) 0:04:29.127 ******* 2019-12-22T22:19:12.658 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-22T22:19:12.659 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.695 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.064) 0:04:29.191 ******* 2019-12-22T22:19:12.722 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-22T22:19:12.724 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.780 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.085) 0:04:29.277 ******* 2019-12-22T22:19:12.810 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-22T22:19:12.812 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.846 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.066) 0:04:29.343 ******* 2019-12-22T22:19:12.863 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:12.864 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwkJs3E7nXshEDQQNkT7OQ0L7KYlNLq5D7'], u'uuids': [u'95b699af-67c0-4aad-b30d-b0c42ec7ccfb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.054083", "end": "2019-12-22 22:19:12.824562", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwkJs3E7nXshEDQQNkT7OQ0L7KYlNLq5D7"], "labels": [], "masters": [], "uuids": ["95b699af-67c0-4aad-b30d-b0c42ec7ccfb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:11.770479", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:12.875 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-22T22:19:12.877 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.915 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.068) 0:04:29.412 ******* 2019-12-22T22:19:12.942 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-22T22:19:12.944 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:12.980 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:12 +0000 (0:00:00.065) 0:04:29.477 ******* 2019-12-22T22:19:13.001 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:13.002 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjf1DFM3fBefguMHHLOqhcHGVzcGLyJZDw'], u'uuids': [u'8759fceb-21be-451a-b969-80627e37d93b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.075960", "end": "2019-12-22 22:19:12.956391", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjf1DFM3fBefguMHHLOqhcHGVzcGLyJZDw"], "labels": [], "masters": [], "uuids": ["8759fceb-21be-451a-b969-80627e37d93b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:11.880431", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:13.004 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-22T22:19:13.005 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.042 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.061) 0:04:29.539 ******* 2019-12-22T22:19:13.069 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-22T22:19:13.074 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.111 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.069) 0:04:29.608 ******* 2019-12-22T22:19:13.138 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-22T22:19:13.139 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.177 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.065) 0:04:29.674 ******* 2019-12-22T22:19:13.205 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-22T22:19:13.206 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.252 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.074) 0:04:29.749 ******* 2019-12-22T22:19:13.281 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-22T22:19:13.282 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.328 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.076) 0:04:29.825 ******* 2019-12-22T22:19:13.355 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-22T22:19:13.357 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.392 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.063) 0:04:29.889 ******* 2019-12-22T22:19:13.419 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-22T22:19:13.421 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.456 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.064) 0:04:29.953 ******* 2019-12-22T22:19:13.485 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-22T22:19:13.487 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.521 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.065) 0:04:30.018 ******* 2019-12-22T22:19:13.559 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-22T22:19:13.565 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.601 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.079) 0:04:30.098 ******* 2019-12-22T22:19:13.628 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-22T22:19:13.630 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.667 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.066) 0:04:30.164 ******* 2019-12-22T22:19:13.705 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:13.707 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-22T22:19:13.751 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.084) 0:04:30.248 ******* 2019-12-22T22:19:13.801 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-22T22:19:13.803 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.813 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-22T22:19:13.813 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.825 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.836 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.837 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.848 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:13.892 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:13 +0000 (0:00:00.141) 0:04:30.389 ******* 2019-12-22T22:19:14.049 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-22T22:19:14.050 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003981", "end": "2019-12-22 22:19:14.024186", "rc": 0, "start": "2019-12-22 22:19:14.020205", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-22T22:19:14.095 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:14 +0000 (0:00:00.202) 0:04:30.591 ******* 2019-12-22T22:19:14.133 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-22T22:19:14.134 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:14.182 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:14 +0000 (0:00:00.087) 0:04:30.679 ******* 2019-12-22T22:19:14.221 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-22T22:19:14.223 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:14.266 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:14 +0000 (0:00:00.084) 0:04:30.763 ******* 2019-12-22T22:19:14.274 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:14.275 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwaGSFWcDAOVr5G10pmqRnRPiEhWXenw3c'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.053328", "end": "2019-12-22 22:19:14.191485", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwaGSFWcDAOVr5G10pmqRnRPiEhWXenw3c"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:13.138157", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:14.309 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-22T22:19:14.311 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:14.349 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:14 +0000 (0:00:00.082) 0:04:30.846 ******* 2019-12-22T22:19:14.376 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-22T22:19:14.378 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:14.382 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:14.383 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpj5Rr8L5au7BHs8KrpGncrSzEeKhyq3RTN'], u'uuids': [u'6f072c45-24ea-402f-8a76-64d3e773ba5a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.079209", "end": "2019-12-22 22:19:14.338333", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpj5Rr8L5au7BHs8KrpGncrSzEeKhyq3RTN"], "labels": [], "masters": [], "uuids": ["6f072c45-24ea-402f-8a76-64d3e773ba5a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:13.259124", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:14.420 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:14 +0000 (0:00:00.071) 0:04:30.917 ******* 2019-12-22T22:19:14.935 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-22T22:19:14.937 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-22T22:19:14.974 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:14 +0000 (0:00:00.554) 0:04:31.471 ******* 2019-12-22T22:19:15.023 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-22T22:19:15.025 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={u'block_used': 13037585, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286899, u'size_available': 930967138304, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966952, u'device': u'/dev/sda1', u'inode_used': 88024, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286899, "block_size": 4096, "block_total": 240324484, "block_used": 13037585, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966952, "inode_total": 61054976, "inode_used": 88024, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967138304, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-22T22:19:15.062 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:15 +0000 (0:00:00.088) 0:04:31.559 ******* 2019-12-22T22:19:15.390 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.013767", "end": "2019-12-22 22:19:15.365475", "rc": 0, "start": "2019-12-22 22:19:15.351708", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:15.443 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:15 +0000 (0:00:00.380) 0:04:31.940 ******* 2019-12-22T22:19:15.490 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-22T22:19:15.491 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'block_used': 13037585, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286899, u'size_available': 930967138304, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966952, u'device': u'/dev/sda1', u'inode_used': 88024, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286899, "block_size": 4096, "block_total": 240324484, "block_used": 13037585, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966952, "inode_total": 61054976, "inode_used": 88024, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967138304, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:15.545 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:15 +0000 (0:00:00.101) 0:04:32.042 ******* 2019-12-22T22:19:15.574 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-22T22:19:15.643 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:15 +0000 (0:00:00.097) 0:04:32.140 ******* 2019-12-22T22:19:15.650 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:15.652 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8Ww3Ba6m6HQ72CQI110OqDXgZr4G1VzbFnK'], u'uuids': [u'a858a199-9f42-4412-b029-8b4f4accd659']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.058289", "end": "2019-12-22 22:19:15.550640", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8Ww3Ba6m6HQ72CQI110OqDXgZr4G1VzbFnK"], "labels": [], "masters": [], "uuids": ["a858a199-9f42-4412-b029-8b4f4accd659"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:14.492351", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:15.697 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QJJR', u'wwn-0x5000c50091e19c4b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QJJR', u'wwn': u'0x5000c50091e19c4b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QJJR-part1', u'wwn-0x5000c50091e19c4b-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJJR", "wwn-0x5000c50091e19c4b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJJR-part1", "wwn-0x5000c50091e19c4b-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QJJR", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-22T22:19:15.700 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e19c4b"}}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:15.776 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjc8DVZfzArjjwtkUIs9scmeKTfqj8iDmF'], u'uuids': [u'99128d03-c0c1-474e-b705-6304f85010d7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.065914", "end": "2019-12-22 22:19:15.731233", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjc8DVZfzArjjwtkUIs9scmeKTfqj8iDmF"], "labels": [], "masters" 2019-12-22T22:19:15.778 INFO:teuthology.task.ansible.out:: [], "uuids": ["99128d03-c0c1-474e-b705-6304f85010d7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:14.665319", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:15.833 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:15 +0000 (0:00:00.189) 0:04:32.329 ******* 2019-12-22T22:19:15.895 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:15.897 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFGH', u'wwn-0x5000c50092924459'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFGH', u'wwn': u'0x5000c50092924459', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFGH-part1', u'wwn-0x5000c50092924459-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFGH", "wwn-0x5000c50092924459"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFGH-part1", "wwn-0x5000c50092924459-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFGH", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-22T22:19:15.898 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092924459"}}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:16.319 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-iccw3H-3tCI-t8ai-B3OF-tmN2-qBjb-AkgmGY', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300KZ400BGN', u'nvme-nvme.8086-435646543632333330304b5a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.087897", "end": "2019-12-22 22:19:16.275835", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-iccw3H-3tCI-t8ai-B3OF-tmN2-qBjb-AkgmGY", "nvme-INTEL_SSDPEDMD400G4_CVFT623300KZ400BGN", "nvme-nvme.8086-435646543632333330304b5a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:16.187938", "stderr": 2019-12-22T22:19:16.321 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0807863 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0807863 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:16.818 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjWUXQWhncf0R6fnCq0zdla4yg1YeMcDux'], u'uuids': [u'2b479011-7ab4-41ab-a8a9-bba464f281c6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.202555", "end": "2019-12-22 22:19:16.787949", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjWUXQWhncf0R6fnCq0zdla4yg1YeMcDux"], "labels": [], "masters": [], "uuids": ["2b479011-7ab4-41ab-a8a9-bba464f281c6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:16.585394", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.19585 s, 589 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.19585 s, 589 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:16.936 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwBGz0ssYxZKeQd9bITuhfIlEbjIeBr1Xz'], u'uuids': [u'70d12799-4fd1-4ce9-a639-f0db6cf140fb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.046351", "end": "2019-12-22 22:19:16.899525", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwBGz0ssYxZKeQd9bITuhfIlEbjIeBr1Xz"], "labels": [], "masters": [], "uuids": ["70d12799-4fd1-4ce9-a639-f0db6cf140fb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:15.853174", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition th 2019-12-22T22:19:16.938 INFO:teuthology.task.ansible.out:e disk using fdisk or", "other utilities."]} 2019-12-22T22:19:17.350 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:17.351 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjnWc36W2yNozeszuXbfLwX49RfGUOT7vS'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.205767", "end": "2019-12-22 22:19:17.310832", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjnWc36W2yNozeszuXbfLwX49RfGUOT7vS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:17.105065", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.198818 s, 580 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.198818 s, 580 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:17.879 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjf1DFM3fBefguMHHLOqhcHGVzcGLyJZDw'], u'uuids': [u'8759fceb-21be-451a-b969-80627e37d93b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.195730", "end": "2019-12-22 22:19:17.843289", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjf1DFM3fBefguMHHLOqhcHGVzcGLyJZDw"], "labels": [], "masters": [], "uuids": ["8759fceb-21be-451a-b969-80627e37d93b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:17.647559", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.189486 s, 609 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.189486 s, 609 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:18.210 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-xuKRdi-grsu-NRPj-SkQD-E2J4-8MmT-3ccn7R', u'nvme-INTEL_SSDPEDMD400G4_PHFT62040172400BGN', u'nvme-nvme.8086-50484654363230343031373234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:02.219815", "end": "2019-12-22 22:19:18.172058", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-xuKRdi-grsu-NRPj-SkQD-E2J4-8MmT-3ccn7R", "nvme-INTEL_SSDPEDMD400G4_PHFT62040172400BGN", "nvme-nvme.8086-50484654363230343031373234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "372.61 GB", "support_discard 2019-12-22T22:19:18.212 INFO:teuthology.task.ansible.out:": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:15.952243", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:18.317 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwPjwVCCm8A1Mv0iG6PwglFbXgIXngpvB8'], u'uuids': [u'fd27bdab-811f-4876-9ebc-033ff0a3d400']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.065048", "end": "2019-12-22 22:19:18.273647", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwPjwVCCm8A1Mv0iG6PwglFbXgIXngpvB8"], "labels": [], "masters": [], "uuids": ["fd27bdab-811f-4876-9ebc-033ff0a3d400"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:17.208599", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:18.367 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:18 +0000 (0:00:02.534) 0:04:34.864 ******* 2019-12-22T22:19:18.386 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:18.388 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpj5Rr8L5au7BHs8KrpGncrSzEeKhyq3RTN'], u'uuids': [u'6f072c45-24ea-402f-8a76-64d3e773ba5a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.186294", "end": "2019-12-22 22:19:18.349741", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpj5Rr8L5au7BHs8KrpGncrSzEeKhyq3RTN"], "labels": [], "masters": [], "uuids": ["6f072c45-24ea-402f-8a76-64d3e773ba5a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:18.163447", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.180437 s, 639 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.180437 s, 639 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:18.412 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFQE', u'wwn-0x5000c5009292232d'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFQE', u'wwn': u'0x5000c5009292232d', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFQE-part1', u'wwn-0x5000c5009292232d-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFQE", "wwn-0x5000c5009292232d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFQE-part1", "wwn-0x5000c5009292232d-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFQE", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-22T22:19:18.413 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c5009292232d"}}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:18.786 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-cZ6ihO-fZ2z-CYtB-igBz-O9Ux-qfCL-SYF0j0', u'nvme-INTEL_SSDPEDMD400G4_PHFT620500MW400BGN', u'nvme-nvme.8086-504846543632303530304d5734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.063889", "end": "2019-12-22 22:19:18.756373", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-cZ6ihO-fZ2z-CYtB-igBz-O9Ux-qfCL-SYF0j0", "nvme-INTEL_SSDPEDMD400G4_PHFT620500MW400BGN", "nvme-nvme.8086-504846543632303530304d5734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:18.692484", "stderr": 2019-12-22T22:19:18.787 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0573127 s, 2.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0573127 s, 2.0 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:18.821 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjc8DVZfzArjjwtkUIs9scmeKTfqj8iDmF'], u'uuids': [u'99128d03-c0c1-474e-b705-6304f85010d7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300KZ400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.181009", "end": "2019-12-22 22:19:18.786527", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2Ga1W3QSW92U9iM3kwDSrj9pO5cUrxpjc8DVZfzArjjwtkUIs9scmeKTfqj8iDmF"], "labels": [], "masters": [], "uuids": ["99128d03-c0c1-474e-b705-6304f85010d7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300KZ400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:18.605518", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.174674 s, 660 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.174674 s, 660 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:18.890 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:18 +0000 (0:00:00.523) 0:04:35.387 ******* 2019-12-22T22:19:19.291 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwkJs3E7nXshEDQQNkT7OQ0L7KYlNLq5D7'], u'uuids': [u'95b699af-67c0-4aad-b30d-b0c42ec7ccfb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.214999", "end": "2019-12-22 22:19:19.249491", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwkJs3E7nXshEDQQNkT7OQ0L7KYlNLq5D7"], "labels": [], "masters": [], "uuids": ["95b699af-67c0-4aad-b30d-b0c42ec7ccfb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:19.034492", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.208018 s, 554 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.208018 s, 554 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:19.314 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-22T22:19:19.316 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.075937", "end": "2019-12-22 22:19:19.264318", "rc": 0, "start": "2019-12-22 22:19:19.188381", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:19.385 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:19 +0000 (0:00:00.493) 0:04:35.881 ******* 2019-12-22T22:19:19.588 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDX3DkX6ajnqEEEYWNNGNhqPseFyyJ2VwF'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.060487", "end": "2019-12-22 22:19:19.535355", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDX3DkX6ajnqEEEYWNNGNhqPseFyyJ2VwF"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:18.474868", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:19.778 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-22T22:19:19.786 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.059309", "end": "2019-12-22 22:19:19.744683", "rc": 0, "start": "2019-12-22 22:19:19.685374", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:19.826 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:19 +0000 (0:00:00.441) 0:04:36.323 ******* 2019-12-22T22:19:19.833 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:19.839 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwaGSFWcDAOVr5G10pmqRnRPiEhWXenw3c'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.194851", "end": "2019-12-22 22:19:19.775857", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwaGSFWcDAOVr5G10pmqRnRPiEhWXenw3c"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:19.581006", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.187972 s, 614 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.187972 s, 614 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:19.847 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-22T22:19:19.905 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:19 +0000 (0:00:00.079) 0:04:36.402 ******* 2019-12-22T22:19:19.960 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:20.002 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:19 +0000 (0:00:00.096) 0:04:36.499 ******* 2019-12-22T22:19:20.032 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-22T22:19:20.034 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:20.075 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:20 +0000 (0:00:00.073) 0:04:36.572 ******* 2019-12-22T22:19:20.112 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-22T22:19:20.114 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:20.153 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:20 +0000 (0:00:00.078) 0:04:36.650 ******* 2019-12-22T22:19:20.190 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-22T22:19:20.192 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:20.229 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:20 +0000 (0:00:00.074) 0:04:36.725 ******* 2019-12-22T22:19:20.299 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:20.300 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8Ww3Ba6m6HQ72CQI110OqDXgZr4G1VzbFnK'], u'uuids': [u'a858a199-9f42-4412-b029-8b4f4accd659']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.168884", "end": "2019-12-22 22:19:20.258940", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8Ww3Ba6m6HQ72CQI110OqDXgZr4G1VzbFnK"], "labels": [], "masters": [], "uuids": ["a858a199-9f42-4412-b029-8b4f4accd659"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:20.090056", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.162774 s, 709 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.162774 s, 709 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:20.546 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-22T22:19:20.547 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:19:20.584 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:20 +0000 (0:00:00.355) 0:04:37.081 ******* 2019-12-22T22:19:20.644 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-22T22:19:20.647 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={u'block_used': 13037652, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286832, u'size_available': 930966863872, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966956, u'device': u'/dev/sda1', u'inode_used': 88020, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286832, "block_size": 4096, "block_total": 240324484, "block_used": 13037652, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966956, "inode_total": 61054976, "inode_used": 88020, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966863872, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:20.691 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:20 +0000 (0:00:00.106) 0:04:37.188 ******* 2019-12-22T22:19:20.720 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-22T22:19:20.722 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:20.760 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:20 +0000 (0:00:00.069) 0:04:37.257 ******* 2019-12-22T22:19:20.787 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:20.789 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:20.834 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:20 +0000 (0:00:00.074) 0:04:37.331 ******* 2019-12-22T22:19:20.848 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:20.850 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwBGz0ssYxZKeQd9bITuhfIlEbjIeBr1Xz'], u'uuids': [u'70d12799-4fd1-4ce9-a639-f0db6cf140fb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.207008", "end": "2019-12-22 22:19:20.787357", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwBGz0ssYxZKeQd9bITuhfIlEbjIeBr1Xz"], "labels": [], "masters": [], "uuids": ["70d12799-4fd1-4ce9-a639-f0db6cf140fb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:20.580349", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.200587 s, 575 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.200587 s, 575 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:20.863 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:20.865 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:20.907 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:20 +0000 (0:00:00.073) 0:04:37.404 ******* 2019-12-22T22:19:20.947 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-22T22:19:20.948 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:20.986 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:20 +0000 (0:00:00.078) 0:04:37.483 ******* 2019-12-22T22:19:20.993 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:20.995 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTD8w9mvpz7EF2HCH2l1a6BffWqBnG0Y3rS'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.056139", "end": "2019-12-22 22:19:20.927408", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTD8w9mvpz7EF2HCH2l1a6BffWqBnG0Y3rS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:19.871269", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:21.018 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-22T22:19:21.020 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:21.057 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:21 +0000 (0:00:00.071) 0:04:37.554 ******* 2019-12-22T22:19:21.084 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-22T22:19:21.086 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:21.126 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:21 +0000 (0:00:00.068) 0:04:37.623 ******* 2019-12-22T22:19:21.275 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:21.276 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwPjwVCCm8A1Mv0iG6PwglFbXgIXngpvB8'], u'uuids': [u'fd27bdab-811f-4876-9ebc-033ff0a3d400']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620500MW400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.179459", "end": "2019-12-22 22:19:21.233506", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2ng6igLJ8dn4hMmBhzh2kveA9nGiL8WwPjwVCCm8A1Mv0iG6PwglFbXgIXngpvB8"], "labels": [], "masters": [], "uuids": ["fd27bdab-811f-4876-9ebc-033ff0a3d400"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620500MW400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:21.054047", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.172992 s, 667 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.172992 s, 667 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:21.328 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:21 +0000 (0:00:00.202) 0:04:37.825 ******* 2019-12-22T22:19:21.763 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-22T22:19:21.764 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.076569", "end": "2019-12-22 22:19:21.721962", "rc": 0, "start": "2019-12-22 22:19:21.645393", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:21.800 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:21 +0000 (0:00:00.471) 0:04:38.297 ******* 2019-12-22T22:19:21.983 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-22T22:19:21.985 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-22T22:19:22.026 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:22 +0000 (0:00:00.226) 0:04:38.523 ******* 2019-12-22T22:19:22.174 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-22T22:19:22.175 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.055531", "end": "2019-12-22 22:19:22.125207", "rc": 0, "start": "2019-12-22 22:19:22.069676", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:22.213 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:22 +0000 (0:00:00.187) 0:04:38.710 ******* 2019-12-22T22:19:22.256 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-22T22:19:22.301 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:22 +0000 (0:00:00.087) 0:04:38.798 ******* 2019-12-22T22:19:22.327 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-22T22:19:22.329 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:22.400 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:22 +0000 (0:00:00.098) 0:04:38.896 ******* 2019-12-22T22:19:22.427 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:22.429 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDtnAtBQINi4XgjMo701DX3ACgM7f1fkLP'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.061935", "end": "2019-12-22 22:19:22.361194", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDtnAtBQINi4XgjMo701DX3ACgM7f1fkLP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:21.299259", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:22.459 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-22T22:19:22.461 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:22.503 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:22 +0000 (0:00:00.103) 0:04:39.000 ******* 2019-12-22T22:19:22.534 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:22.595 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:22 +0000 (0:00:00.092) 0:04:39.092 ******* 2019-12-22T22:19:22.638 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-22T22:19:22.639 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:22.684 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:22 +0000 (0:00:00.085) 0:04:39.178 ******* 2019-12-22T22:19:22.819 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-22T22:19:22.821 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:23.037 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-22T22:19:23.038 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:19:23.089 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:23 +0000 (0:00:00.408) 0:04:39.586 ******* 2019-12-22T22:19:23.139 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-22T22:19:23.140 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={u'block_used': 13037565, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286919, u'size_available': 930967220224, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966956, u'device': u'/dev/sda1', u'inode_used': 88020, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286919, "block_size": 4096, "block_total": 240324484, "block_used": 13037565, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966956, "inode_total": 61054976, "inode_used": 88020, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967220224, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:23.182 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:23 +0000 (0:00:00.092) 0:04:39.678 ******* 2019-12-22T22:19:23.209 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-22T22:19:23.216 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:23.248 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:23 +0000 (0:00:00.065) 0:04:39.744 ******* 2019-12-22T22:19:23.275 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:23.276 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:23.317 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:23 +0000 (0:00:00.069) 0:04:39.814 ******* 2019-12-22T22:19:23.324 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:23.349 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:23.351 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:23.396 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:23 +0000 (0:00:00.079) 0:04:39.893 ******* 2019-12-22T22:19:23.434 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-22T22:19:23.436 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:23.476 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:23 +0000 (0:00:00.079) 0:04:39.973 ******* 2019-12-22T22:19:23.515 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-22T22:19:23.517 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:23.554 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:23 +0000 (0:00:00.078) 0:04:40.051 ******* 2019-12-22T22:19:23.582 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-22T22:19:23.584 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:23.620 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:23 +0000 (0:00:00.065) 0:04:40.117 ******* 2019-12-22T22:19:23.789 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:23.791 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDk4xdq71Y7FrxeolEZ8PQKHAxhjeSvjbA'], u'uuids': [u'f435180f-6d84-43f5-b3b7-fb7ae563e7db']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.059199", "end": "2019-12-22 22:19:23.745894", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDk4xdq71Y7FrxeolEZ8PQKHAxhjeSvjbA"], "labels": [], "masters": 2019-12-22T22:19:23.791 INFO:teuthology.task.ansible.out: [], "uuids": ["f435180f-6d84-43f5-b3b7-fb7ae563e7db"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:22.686695", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:23.793 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:24.186 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-22T22:19:24.224 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:24 +0000 (0:00:00.603) 0:04:40.721 ******* 2019-12-22T22:19:24.225 INFO:teuthology.task.ansible.out: 2019-12-22T22:19:24.297 INFO:teuthology.task.ansible.out: 2019-12-22T22:19:24.299 INFO:teuthology.task.ansible.out:TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:24.748 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:24.791 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:24.832 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:24 +0000 (0:00:00.608) 0:04:41.329 ******* 2019-12-22T22:19:25.177 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:25.178 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDbMwiGGhaymVddkUnpeeiM6s7nYIW4I7v'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.085105", "end": "2019-12-22 22:19:25.136137", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDbMwiGGhaymVddkUnpeeiM6s7nYIW4I7v"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:24.051032", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-22T22:19:25.180 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-22T22:19:25.183 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-22T22:19:25.224 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:25 +0000 (0:00:00.391) 0:04:41.721 ******* 2019-12-22T22:19:25.269 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:25 +0000 (0:00:00.044) 0:04:41.766 ******* 2019-12-22T22:19:25.288 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QJJR', u'wwn-0x5000c50091e19c4b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QJJR', u'wwn': u'0x5000c50091e19c4b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QJJR-part1', u'wwn-0x5000c50091e19c4b-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJJR", "wwn-0x5000c50091e19c4b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJJR-part1", "wwn-0x5000c50091e19c4b-p 2019-12-22T22:19:25.289 INFO:teuthology.task.ansible.out:art1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QJJR", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e19c4b"}}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:25.315 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:25.316 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:25.620 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:25.621 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-xuKRdi-grsu-NRPj-SkQD-E2J4-8MmT-3ccn7R', u'nvme-INTEL_SSDPEDMD400G4_PHFT62040172400BGN', u'nvme-nvme.8086-50484654363230343031373234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.062023", "end": "2019-12-22 22:19:25.588926", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-xuKRdi-grsu-NRPj-SkQD-E2J4-8MmT-3ccn7R", "nvme-INTEL_SSDPEDMD400G4_PHFT62040172400BGN", "nvme-nvme.8086-50484654363230343031373234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:25.526903", "stderr": 2019-12-22T22:19:25.623 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0559914 s, 2.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0559914 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:25.623 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:25.701 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-22T22:19:25.702 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:25.935 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:25.937 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:26.116 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:26.117 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDX3DkX6ajnqEEEYWNNGNhqPseFyyJ2VwF'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.212035", "end": "2019-12-22 22:19:26.088309", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDX3DkX6ajnqEEEYWNNGNhqPseFyyJ2VwF"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:25.876274", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.205767 s, 561 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.205767 s, 561 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:26.204 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-22T22:19:26.206 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:26.247 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:26.248 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:26.560 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:26.608 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:26 +0000 (0:00:01.338) 0:04:43.104 ******* 2019-12-22T22:19:26.616 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:26.617 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTD8w9mvpz7EF2HCH2l1a6BffWqBnG0Y3rS'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.170046", "end": "2019-12-22 22:19:26.546408", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTD8w9mvpz7EF2HCH2l1a6BffWqBnG0Y3rS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:26.376362", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.164525 s, 701 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.164525 s, 701 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:26.663 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-22T22:19:26.665 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:26.712 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:26 +0000 (0:00:00.103) 0:04:43.208 ******* 2019-12-22T22:19:26.951 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-22T22:19:26.952 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-22T22:19:27.014 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:27 +0000 (0:00:00.302) 0:04:43.511 ******* 2019-12-22T22:19:27.024 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-22T22:19:27.025 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-22T22:19:27.072 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:27 +0000 (0:00:00.056) 0:04:43.568 ******* 2019-12-22T22:19:27.078 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-22T22:19:27.080 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:27.081 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDtnAtBQINi4XgjMo701DX3ACgM7f1fkLP'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.199527", "end": "2019-12-22 22:19:27.045333", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDtnAtBQINi4XgjMo701DX3ACgM7f1fkLP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:26.845806", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.192735 s, 598 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.192735 s, 598 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:27.123 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:27 +0000 (0:00:00.051) 0:04:43.620 ******* 2019-12-22T22:19:27.130 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:27.131 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:27.444 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:27.587 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:27.588 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDk4xdq71Y7FrxeolEZ8PQKHAxhjeSvjbA'], u'uuids': [u'f435180f-6d84-43f5-b3b7-fb7ae563e7db']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.174777", "end": "2019-12-22 22:19:27.556871", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDk4xdq71Y7FrxeolEZ8PQKHAxhjeSvjbA"], "labels": [], "masters": [], "uuids": ["f435180f-6d84-43f5-b3b7-fb7ae563e7db"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:27.382094", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.16831 s, 685 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.16831 s, 685 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:27.790 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:27.792 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:27.897 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-22T22:19:27.899 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true} 2019-12-22T22:19:27.936 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:27 +0000 (0:00:00.813) 0:04:44.433 ******* 2019-12-22T22:19:28.039 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-22T22:19:28.043 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDbMwiGGhaymVddkUnpeeiM6s7nYIW4I7v'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT62040172400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.170470", "end": "2019-12-22 22:19:28.013331", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-1ZRheTHicXIecgZRANLv6YYKmc4pfFTDbMwiGGhaymVddkUnpeeiM6s7nYIW4I7v"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT62040172400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-22 22:19:27.842861", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.1645 s, 701 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.1645 s, 701 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:28.125 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:28 +0000 (0:00:00.188) 0:04:44.621 ******* 2019-12-22T22:19:28.133 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:28.134 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:28.443 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:28.492 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:28 +0000 (0:00:00.366) 0:04:44.988 ******* 2019-12-22T22:19:28.563 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-22T22:19:28.564 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.090853", "end": "2019-12-22 22:19:28.516692", "rc": 0, "start": "2019-12-22 22:19:28.425839", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:28.603 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:28 +0000 (0:00:00.111) 0:04:45.100 ******* 2019-12-22T22:19:28.686 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-22T22:19:28.688 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-22T22:19:28.751 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:28 +0000 (0:00:00.148) 0:04:45.248 ******* 2019-12-22T22:19:28.778 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-22T22:19:28.780 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:28.817 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:28 +0000 (0:00:00.065) 0:04:45.314 ******* 2019-12-22T22:19:28.825 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-22T22:19:28.825 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-22T22:19:28.871 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:28 +0000 (0:00:00.053) 0:04:45.367 ******* 2019-12-22T22:19:28.880 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-22T22:19:28.881 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:28.924 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:28 +0000 (0:00:00.053) 0:04:45.421 ******* 2019-12-22T22:19:28.931 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-22T22:19:28.933 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-22T22:19:28.972 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:28 +0000 (0:00:00.047) 0:04:45.468 ******* 2019-12-22T22:19:28.978 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-22T22:19:28.978 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:29.018 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.045) 0:04:45.514 ******* 2019-12-22T22:19:29.025 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-22T22:19:29.026 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.059685", "end": "2019-12-22 22:19:28.955046", "rc": 0, "start": "2019-12-22 22:19:28.895361", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:29.065 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.047) 0:04:45.562 ******* 2019-12-22T22:19:29.074 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-22T22:19:29.076 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:29.112 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.046) 0:04:45.609 ******* 2019-12-22T22:19:29.118 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-22T22:19:29.161 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.049) 0:04:45.658 ******* 2019-12-22T22:19:29.167 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-22T22:19:29.168 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:29.206 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.044) 0:04:45.703 ******* 2019-12-22T22:19:29.212 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-22T22:19:29.213 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:29.257 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.051) 0:04:45.754 ******* 2019-12-22T22:19:29.264 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-22T22:19:29.265 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:29.305 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.047) 0:04:45.802 ******* 2019-12-22T22:19:29.312 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-22T22:19:29.314 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:29.360 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.050) 0:04:45.853 ******* 2019-12-22T22:19:29.366 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-22T22:19:29.366 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:29.414 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.058) 0:04:45.911 ******* 2019-12-22T22:19:29.421 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-22T22:19:29.422 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi187.front.sepia.ceph.com] => {"changed": true} 2019-12-22T22:19:29.473 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.059) 0:04:45.970 ******* 2019-12-22T22:19:29.512 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.038) 0:04:46.009 ******* 2019-12-22T22:19:29.530 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-22T22:19:29.532 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:29.571 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.059) 0:04:46.068 ******* 2019-12-22T22:19:29.899 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-22T22:19:29.901 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-22T22:19:29.944 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.372) 0:04:46.440 ******* 2019-12-22T22:19:29.951 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-22T22:19:29.951 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-22T22:19:29.999 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:29 +0000 (0:00:00.054) 0:04:46.495 ******* 2019-12-22T22:19:30.006 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-22T22:19:30.008 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-22T22:19:30.064 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.057) 0:04:46.553 ******* 2019-12-22T22:19:30.105 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.048) 0:04:46.601 ******* 2019-12-22T22:19:30.112 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-22T22:19:30.113 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={u'block_used': 13037585, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286899, u'size_available': 930967138304, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966952, u'device': u'/dev/sda1', u'inode_used': 88024, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286899, "block_size": 4096, "block_total": 240324484, "block_used": 13037585, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966952, "inode_total": 61054976, "inode_used": 88024, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930967138304, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.115 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-22T22:19:30.116 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.154 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.049) 0:04:46.651 ******* 2019-12-22T22:19:30.194 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.040) 0:04:46.691 ******* 2019-12-22T22:19:30.201 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-22T22:19:30.203 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.245 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.049) 0:04:46.740 ******* 2019-12-22T22:19:30.281 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.037) 0:04:46.778 ******* 2019-12-22T22:19:30.288 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:30.289 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.337 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.055) 0:04:46.833 ******* 2019-12-22T22:19:30.343 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-22T22:19:30.347 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.384 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.047) 0:04:46.881 ******* 2019-12-22T22:19:30.386 INFO:teuthology.task.ansible.out: 2019-12-22T22:19:30.392 INFO:teuthology.task.ansible.out: 2019-12-22T22:19:30.394 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.432 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.048) 0:04:46.929 ******* 2019-12-22T22:19:30.440 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-22T22:19:30.441 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.487 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.054) 0:04:46.983 ******* 2019-12-22T22:19:30.488 INFO:teuthology.task.ansible.out: 2019-12-22T22:19:30.503 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-22T22:19:30.504 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.546 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.059) 0:04:47.043 ******* 2019-12-22T22:19:30.553 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-22T22:19:30.554 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.594 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.047) 0:04:47.091 ******* 2019-12-22T22:19:30.596 INFO:teuthology.task.ansible.out: 2019-12-22T22:19:30.612 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-22T22:19:30.614 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.656 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.062) 0:04:47.153 ******* 2019-12-22T22:19:30.668 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.708 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.051) 0:04:47.205 ******* 2019-12-22T22:19:30.713 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-22T22:19:30.715 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.756 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.048) 0:04:47.253 ******* 2019-12-22T22:19:30.765 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.810 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.053) 0:04:47.307 ******* 2019-12-22T22:19:30.836 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-22T22:19:30.838 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:30.874 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:30 +0000 (0:00:00.064) 0:04:47.371 ******* 2019-12-22T22:19:31.166 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-22T22:19:31.167 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-22T22:19:31.216 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:31 +0000 (0:00:00.341) 0:04:47.712 ******* 2019-12-22T22:19:31.244 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-22T22:19:31.246 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:31.294 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:31 +0000 (0:00:00.078) 0:04:47.791 ******* 2019-12-22T22:19:31.324 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-22T22:19:31.325 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-22T22:19:31.385 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:31 +0000 (0:00:00.089) 0:04:47.880 ******* 2019-12-22T22:19:31.392 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-22T22:19:31.393 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-22T22:19:31.446 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:31 +0000 (0:00:00.062) 0:04:47.943 ******* 2019-12-22T22:19:31.484 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-22T22:19:31.486 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:31.527 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:31 +0000 (0:00:00.081) 0:04:48.024 ******* 2019-12-22T22:19:31.566 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-22T22:19:31.568 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:31.605 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:31 +0000 (0:00:00.077) 0:04:48.102 ******* 2019-12-22T22:19:31.837 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-22T22:19:31.839 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "-.mount sntp.service basic.target ntpdate.service systemd-journald.socket system.slice tmp.mount syslog.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-22T22:19:31.841 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-22T22:19:31.842 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-22T22:19:31.880 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:31 +0000 (0:00:00.274) 0:04:48.377 ******* 2019-12-22T22:19:31.918 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-22T22:19:31.920 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:32.419 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:32.495 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-22T22:19:32.497 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-22T22:19:32.548 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:32 +0000 (0:00:00.668) 0:04:49.045 ******* 2019-12-22T22:19:32.591 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-22T22:19:32.593 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:32.635 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:32 +0000 (0:00:00.086) 0:04:49.132 ******* 2019-12-22T22:19:32.811 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-22T22:19:32.813 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-22T22:19:32.865 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:32 +0000 (0:00:00.229) 0:04:49.361 ******* 2019-12-22T22:19:32.893 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-22T22:19:32.895 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:32.931 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:32 +0000 (0:00:00.066) 0:04:49.428 ******* 2019-12-22T22:19:32.933 INFO:teuthology.task.ansible.out: 2019-12-22T22:19:32.937 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-22T22:19:32.938 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:32.961 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-22T22:19:32.963 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:33.002 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:32 +0000 (0:00:00.070) 0:04:49.499 ******* 2019-12-22T22:19:33.158 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-22T22:19:33.160 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "ntpdate.service basic.target sntp.service syslog.target system.slice tmp.mount systemd-journald.socket -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-22T22:19:33.161 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-22T22:19:33.164 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-22T22:19:33.200 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:33 +0000 (0:00:00.198) 0:04:49.697 ******* 2019-12-22T22:19:33.333 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-22T22:19:33.373 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:33 +0000 (0:00:00.173) 0:04:49.870 ******* 2019-12-22T22:19:33.402 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-22T22:19:33.437 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:33.856 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-22T22:19:33.897 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:33 +0000 (0:00:00.523) 0:04:50.394 ******* 2019-12-22T22:19:34.141 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-22T22:19:34.143 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-22T22:19:34.181 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:34 +0000 (0:00:00.283) 0:04:50.678 ******* 2019-12-22T22:19:34.209 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-22T22:19:34.210 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:34.249 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:34 +0000 (0:00:00.067) 0:04:50.746 ******* 2019-12-22T22:19:34.255 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-22T22:19:34.256 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-22T22:19:34.301 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:34 +0000 (0:00:00.052) 0:04:50.798 ******* 2019-12-22T22:19:34.310 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:34.358 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:34 +0000 (0:00:00.056) 0:04:50.854 ******* 2019-12-22T22:19:34.404 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:34 +0000 (0:00:00.047) 0:04:50.901 ******* 2019-12-22T22:19:34.414 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:34.415 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:34.705 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:34.752 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-22T22:19:34.754 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-22T22:19:34.796 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:34 +0000 (0:00:00.392) 0:04:51.293 ******* 2019-12-22T22:19:35.190 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:35.191 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:35.499 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:35.747 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-22T22:19:35.749 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-22T22:19:35.813 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:35 +0000 (0:00:01.015) 0:04:52.309 ******* 2019-12-22T22:19:35.820 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-22T22:19:35.821 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-22T22:19:35.867 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:35 +0000 (0:00:00.054) 0:04:52.363 ******* 2019-12-22T22:19:36.202 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-22T22:19:36.203 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-22T22:19:36.254 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:36 +0000 (0:00:00.387) 0:04:52.751 ******* 2019-12-22T22:19:36.263 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-22T22:19:36.265 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-22T22:19:36.313 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:36 +0000 (0:00:00.058) 0:04:52.810 ******* 2019-12-22T22:19:36.321 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-22T22:19:36.322 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:36.370 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:36 +0000 (0:00:00.055) 0:04:52.866 ******* 2019-12-22T22:19:36.388 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-22T22:19:36.428 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:36 +0000 (0:00:00.058) 0:04:52.925 ******* 2019-12-22T22:19:36.436 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-22T22:19:36.440 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-22T22:19:36.480 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:36 +0000 (0:00:00.051) 0:04:52.976 ******* 2019-12-22T22:19:36.790 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-22T22:19:36.792 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-22T22:19:36.844 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:36 +0000 (0:00:00.364) 0:04:53.341 ******* 2019-12-22T22:19:36.872 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-22T22:19:36.874 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:36.912 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:36 +0000 (0:00:00.068) 0:04:53.409 ******* 2019-12-22T22:19:36.920 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-22T22:19:36.922 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true} 2019-12-22T22:19:36.961 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:36 +0000 (0:00:00.048) 0:04:53.458 ******* 2019-12-22T22:19:36.968 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-22T22:19:36.968 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-22T22:19:37.029 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.067) 0:04:53.526 ******* 2019-12-22T22:19:37.058 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-22T22:19:37.060 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:37.122 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.093) 0:04:53.619 ******* 2019-12-22T22:19:37.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-22T22:19:37.272 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-22T22:19:37.317 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.194) 0:04:53.814 ******* 2019-12-22T22:19:37.356 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:37.399 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.081) 0:04:53.895 ******* 2019-12-22T22:19:37.426 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-22T22:19:37.428 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-22T22:19:37.471 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.071) 0:04:53.967 ******* 2019-12-22T22:19:37.477 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-22T22:19:37.478 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-22T22:19:37.479 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-22T22:19:37.523 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.051) 0:04:54.019 ******* 2019-12-22T22:19:37.565 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.042) 0:04:54.062 ******* 2019-12-22T22:19:37.571 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-22T22:19:37.575 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:37.618 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.053) 0:04:54.115 ******* 2019-12-22T22:19:37.681 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-22T22:19:37.683 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:37.720 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.101) 0:04:54.217 ******* 2019-12-22T22:19:37.749 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:37.794 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.073) 0:04:54.291 ******* 2019-12-22T22:19:37.802 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-22T22:19:37.803 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-22T22:19:37.847 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.053) 0:04:54.344 ******* 2019-12-22T22:19:37.857 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-22T22:19:37.858 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-22T22:19:37.860 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-22T22:19:37.907 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.059) 0:04:54.404 ******* 2019-12-22T22:19:37.943 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.035) 0:04:54.440 ******* 2019-12-22T22:19:37.951 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-22T22:19:37.952 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:37.952 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:37.994 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:37 +0000 (0:00:00.050) 0:04:54.490 ******* 2019-12-22T22:19:38.032 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.038) 0:04:54.529 ******* 2019-12-22T22:19:38.038 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-22T22:19:38.040 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-22T22:19:38.041 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.086 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.054) 0:04:54.583 ******* 2019-12-22T22:19:38.122 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.035) 0:04:54.619 ******* 2019-12-22T22:19:38.127 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-22T22:19:38.129 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-22T22:19:38.136 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.170 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.047) 0:04:54.667 ******* 2019-12-22T22:19:38.214 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.043) 0:04:54.710 ******* 2019-12-22T22:19:38.220 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-22T22:19:38.222 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.224 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.264 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.050) 0:04:54.761 ******* 2019-12-22T22:19:38.270 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-22T22:19:38.272 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.311 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.046) 0:04:54.808 ******* 2019-12-22T22:19:38.317 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-22T22:19:38.319 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi168.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.467 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.469 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.482 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.520 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.207) 0:04:55.015 ******* 2019-12-22T22:19:38.556 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.612 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.093) 0:04:55.109 ******* 2019-12-22T22:19:38.640 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-22T22:19:38.642 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.685 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.072) 0:04:55.181 ******* 2019-12-22T22:19:38.692 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-22T22:19:38.827 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-22T22:19:38.829 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-22T22:19:38.867 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.180) 0:04:55.362 ******* 2019-12-22T22:19:38.902 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.036) 0:04:55.399 ******* 2019-12-22T22:19:38.913 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:38.952 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.047) 0:04:55.447 ******* 2019-12-22T22:19:38.990 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:38 +0000 (0:00:00.039) 0:04:55.487 ******* 2019-12-22T22:19:38.998 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-22T22:19:39.000 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.038 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.047) 0:04:55.535 ******* 2019-12-22T22:19:39.044 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-22T22:19:39.047 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.091 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.052) 0:04:55.587 ******* 2019-12-22T22:19:39.118 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-22T22:19:39.120 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.160 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.069) 0:04:55.657 ******* 2019-12-22T22:19:39.187 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-22T22:19:39.189 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.239 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.078) 0:04:55.735 ******* 2019-12-22T22:19:39.246 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-22T22:19:39.247 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-22T22:19:39.287 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.048) 0:04:55.784 ******* 2019-12-22T22:19:39.293 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-22T22:19:39.293 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.336 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.048) 0:04:55.833 ******* 2019-12-22T22:19:39.343 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-22T22:19:39.345 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.383 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.047) 0:04:55.880 ******* 2019-12-22T22:19:39.391 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-22T22:19:39.391 INFO:teuthology.task.ansible.out:skipping: [smithi168.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.434 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.050) 0:04:55.931 ******* 2019-12-22T22:19:39.442 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-22T22:19:39.442 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.453 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.454 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.465 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.466 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.520 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.086) 0:04:56.017 ******* 2019-12-22T22:19:39.559 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-22T22:19:39.560 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.571 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.573 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.587 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.589 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.663 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.142) 0:04:56.160 ******* 2019-12-22T22:19:39.711 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:39.712 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.756 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.093) 0:04:56.253 ******* 2019-12-22T22:19:39.785 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-22T22:19:39.787 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.016370", "end": "2019-12-22 22:19:39.741872", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-22 22:19:39.725502", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.826 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.069) 0:04:56.322 ******* 2019-12-22T22:19:39.852 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-22T22:19:39.854 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.919 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.092) 0:04:56.415 ******* 2019-12-22T22:19:39.947 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:39.996 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:39 +0000 (0:00:00.078) 0:04:56.493 ******* 2019-12-22T22:19:40.004 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-22T22:19:40.046 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:40 +0000 (0:00:00.049) 0:04:56.542 ******* 2019-12-22T22:19:40.054 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:40.097 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:40 +0000 (0:00:00.051) 0:04:56.594 ******* 2019-12-22T22:19:40.109 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi168.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007084", "end": "2019-12-22 22:19:40.035045", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-22 22:19:40.027961", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:40.147 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:40 +0000 (0:00:00.049) 0:04:56.644 ******* 2019-12-22T22:19:40.155 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:40.198 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:40 +0000 (0:00:00.047) 0:04:56.692 ******* 2019-12-22T22:19:40.243 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-22T22:19:40.245 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:40.283 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:40 +0000 (0:00:00.087) 0:04:56.780 ******* 2019-12-22T22:19:40.330 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-22T22:19:40.332 INFO:teuthology.task.ansible.out:skipping: [smithi187.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:40.383 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:40 +0000 (0:00:00.100) 0:04:56.880 ******* 2019-12-22T22:19:40.390 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-22T22:19:40.391 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006735", "end": "2019-12-22 22:19:40.318889", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-22 22:19:40.312154", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:40.660 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-22T22:19:40.662 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "-.mount system.slice sntp.service basic.target syslog.target systemd-journald.socket tmp.mount ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-22T22:19:40.664 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-22T22:19:40.667 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-22T22:19:40.703 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:40 +0000 (0:00:00.319) 0:04:57.200 ******* 2019-12-22T22:19:40.710 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-22T22:19:40.713 INFO:teuthology.task.ansible.out:ok: [smithi168.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.008298", "end": "2019-12-22 22:19:40.616888", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-22 22:19:40.608590", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:40.718 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.013873", "end": "2019-12-22 22:19:40.677280", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-22 22:19:40.663407", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:40.756 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:40 +0000 (0:00:00.052) 0:04:57.253 ******* 2019-12-22T22:19:40.783 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-22T22:19:40.822 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:40 +0000 (0:00:00.066) 0:04:57.319 ******* 2019-12-22T22:19:41.044 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-22T22:19:41.045 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007929", "end": "2019-12-22 22:19:41.010399", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-22 22:19:41.002470", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:41.140 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-22T22:19:41.142 INFO:teuthology.task.ansible.out:changed: [smithi168.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-22T22:19:41.356 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-22T22:19:41.366 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007281", "end": "2019-12-22 22:19:41.312631", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-22 22:19:41.305350", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:41.571 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-22T22:19:41.573 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-22T22:19:41.608 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:41 +0000 (0:00:00.785) 0:04:58.105 ******* 2019-12-22T22:19:41.635 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-22T22:19:41.637 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:41.674 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:41 +0000 (0:00:00.066) 0:04:58.171 ******* 2019-12-22T22:19:41.692 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-22T22:19:41.693 INFO:teuthology.task.ansible.out:ok: [smithi187.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007401", "end": "2019-12-22 22:19:41.638756", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-22 22:19:41.631355", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:41.747 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:41 +0000 (0:00:00.072) 0:04:58.244 ******* 2019-12-22T22:19:41.754 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-22T22:19:41.756 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:41.796 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:41 +0000 (0:00:00.048) 0:04:58.293 ******* 2019-12-22T22:19:41.804 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-22T22:19:41.855 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:41 +0000 (0:00:00.057) 0:04:58.350 ******* 2019-12-22T22:19:42.135 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-22T22:19:42.137 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-22T22:19:42.180 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:42 +0000 (0:00:00.326) 0:04:58.676 ******* 2019-12-22T22:19:42.201 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-22T22:19:42.203 INFO:teuthology.task.ansible.out:changed: [smithi187.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-22T22:19:43.102 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-22T22:19:43.104 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-22T22:19:43.139 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:43 +0000 (0:00:00.959) 0:04:59.636 ******* 2019-12-22T22:19:44.647 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-22T22:19:44.649 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-22T22:19:44.684 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:44 +0000 (0:00:01.544) 0:05:01.180 ******* 2019-12-22T22:19:44.711 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-22T22:19:44.713 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:44.748 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:44 +0000 (0:00:00.064) 0:05:01.244 ******* 2019-12-22T22:19:44.786 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-22T22:19:44.788 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-22T22:19:44.825 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:44 +0000 (0:00:00.077) 0:05:01.322 ******* 2019-12-22T22:19:45.151 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-22T22:19:45.153 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-22T22:19:45.191 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:45 +0000 (0:00:00.366) 0:05:01.688 ******* 2019-12-22T22:19:45.218 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-22T22:19:45.220 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:45.254 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:45 +0000 (0:00:00.063) 0:05:01.751 ******* 2019-12-22T22:19:45.281 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-22T22:19:45.283 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-22T22:19:45.329 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:45 +0000 (0:00:00.074) 0:05:01.826 ******* 2019-12-22T22:19:45.371 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:45.404 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:45 +0000 (0:00:00.074) 0:05:01.901 ******* 2019-12-22T22:19:45.739 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-22T22:19:45.740 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-22T22:19:45.781 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:45 +0000 (0:00:00.376) 0:05:02.277 ******* 2019-12-22T22:19:46.097 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-22T22:19:46.099 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-22T22:19:46.145 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.364) 0:05:02.642 ******* 2019-12-22T22:19:46.172 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-22T22:19:46.173 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.213 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.067) 0:05:02.710 ******* 2019-12-22T22:19:46.252 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-22T22:19:46.252 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.265 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.266 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.276 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.288 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.327 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.114) 0:05:02.824 ******* 2019-12-22T22:19:46.376 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-22T22:19:46.377 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.379 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.401 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.402 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.413 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.453 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.125) 0:05:02.950 ******* 2019-12-22T22:19:46.481 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-22T22:19:46.483 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.524 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.070) 0:05:03.021 ******* 2019-12-22T22:19:46.552 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-22T22:19:46.554 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.593 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.066) 0:05:03.087 ******* 2019-12-22T22:19:46.617 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-22T22:19:46.619 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.666 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.075) 0:05:03.163 ******* 2019-12-22T22:19:46.696 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-22T22:19:46.698 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.733 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.067) 0:05:03.230 ******* 2019-12-22T22:19:46.783 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-22T22:19:46.785 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.832 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.098) 0:05:03.328 ******* 2019-12-22T22:19:46.860 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-22T22:19:46.862 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.901 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.068) 0:05:03.397 ******* 2019-12-22T22:19:46.944 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-22T22:19:46.946 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:46.985 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:46 +0000 (0:00:00.084) 0:05:03.482 ******* 2019-12-22T22:19:47.012 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-22T22:19:47.014 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-22T22:19:47.052 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:47 +0000 (0:00:00.067) 0:05:03.549 ******* 2019-12-22T22:19:47.426 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-22T22:19:47.427 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.016460", "end": "2019-12-22 22:19:47.374634", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-22 22:19:47.358174", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:48.744 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:01.009081", "end": "2019-12-22 22:19:48.693891", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-22 22:19:47.684810", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:49.035 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007127", "end": "2019-12-22 22:19:49.004132", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-22 22:19:48.997005", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:49.359 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.008875", "end": "2019-12-22 22:19:49.322929", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-22 22:19:49.314054", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-22T22:19:49.401 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:49 +0000 (0:00:02.348) 0:05:05.897 ******* 2019-12-22T22:19:49.427 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-22T22:19:49.469 INFO:teuthology.task.ansible.out:Sunday 22 December 2019 22:19:49 +0000 (0:00:00.069) 0:05:05.966 ******* 2019-12-22T22:19:49.803 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-22T22:19:49.805 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-22T22:19:49.928 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-12-22T22:19:49.933 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-12-22T22:19:49.935 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2019-12-22T22:19:49.936 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi071.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=161 rescued=0 ignored=3 smithi168.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=161 rescued=0 ignored=3 smithi187.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=161 rescued=0 ignored=3 Sunday 22 December 2019 22:19:49 +0000 (0:00:00.465) 0:05:06.432 ******* =============================================================================== users : Create all admin users with sudo access. ----------------------- 35.75s 2019-12-22T22:19:49.937 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 25.51s common : nrpe - Ensure SELinux policy is up to date -------------------- 16.03s testnode : Install packages -------------------------------------------- 12.42s users : Remove revoked users -------------------------------------------- 6.58s Gathering Facts --------------------------------------------------------- 3.41s testnode : Ensure ceph dependency packages are not present. ------------- 3.39s ansible-managed : Add authorized keys for the ansible user. ------------- 2.97s testnode : Rebuild rpmdb ------------------------------------------------ 2.48s users : Update authorized_keys for each user with literal keys ---------- 2.45s common : Configure local epel mirrorlists ------------------------------- 2.43s testnode : List any leftover Ceph artifacts from previous jobs ---------- 2.35s 2019-12-22T22:19:49.937 INFO:teuthology.task.ansible.out:common : Update yum cache ----------------------------------------------- 2.14s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.97s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.67s common : Set the hardware clock ----------------------------------------- 1.65s testnode : Install packages via pip ------------------------------------- 1.54s ansi 2019-12-22T22:19:49.939 INFO:teuthology.task.ansible.out:ble-managed : Create the cephlab_sudo sudoers.d file. --------------- 1.52s common : Upload nagios nrpe config. ------------------------------------- 1.00s testnode : Configure /etc/security/limits.conf -------------------------- 0.96s 2019-12-22T22:19:50.243 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi168.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2019-12-22T22:19:50.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:19:50.246 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi168.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:19:50.348 INFO:teuthology.orchestra.run.smithi168:> true 2019-12-22T22:19:50.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:19:50.689 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi071.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:19:50.796 INFO:teuthology.orchestra.run.smithi071:> true 2019-12-22T22:19:51.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-22T22:19:51.168 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi187.front.sepia.ceph.com', 'timeout': 60} 2019-12-22T22:19:51.272 INFO:teuthology.orchestra.run.smithi187:> true 2019-12-22T22:19:51.670 INFO:teuthology.run_tasks:Running task clock... 2019-12-22T22:19:51.727 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-12-22T22:19:51.727 INFO:teuthology.orchestra.run.smithi168:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-22T22:19:51.861 INFO:teuthology.orchestra.run.smithi168.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-22T22:20:01.948 INFO:teuthology.orchestra.run.smithi168.stdout:ntpd: time slew -0.000821s 2019-12-22T22:20:01.994 INFO:teuthology.orchestra.run.smithi168.stderr:Failed to start ntp.service: Unit not found. 2019-12-22T22:20:02.071 INFO:teuthology.orchestra.run.smithi168.stdout: remote refid st t when poll reach delay offset jitter 2019-12-22T22:20:02.071 INFO:teuthology.orchestra.run.smithi168.stdout:============================================================================== 2019-12-22T22:20:02.071 INFO:teuthology.orchestra.run.smithi168.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:02.072 INFO:teuthology.orchestra.run.smithi168.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:02.072 INFO:teuthology.orchestra.run.smithi168.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:02.072 INFO:teuthology.orchestra.run.smithi168.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:02.072 INFO:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-22T22:20:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-22T22:20:12.318 INFO:teuthology.orchestra.run.smithi071.stdout:ntpd: time slew -0.001713s 2019-12-22T22:20:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit not found. 2019-12-22T22:20:12.427 INFO:teuthology.orchestra.run.smithi071.stdout: remote refid st t when poll reach delay offset jitter 2019-12-22T22:20:12.427 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================== 2019-12-22T22:20:12.427 INFO:teuthology.orchestra.run.smithi071.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:12.428 INFO:teuthology.orchestra.run.smithi071.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:12.428 INFO:teuthology.orchestra.run.smithi071.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:12.428 INFO:teuthology.orchestra.run.smithi071.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:12.429 INFO:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-22T22:20:12.579 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-22T22:20:22.663 INFO:teuthology.orchestra.run.smithi187.stdout:ntpd: time slew +0.000973s 2019-12-22T22:20:22.702 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit not found. 2019-12-22T22:20:22.776 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2019-12-22T22:20:22.776 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2019-12-22T22:20:22.777 INFO:teuthology.orchestra.run.smithi187.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:22.777 INFO:teuthology.orchestra.run.smithi187.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:22.777 INFO:teuthology.orchestra.run.smithi187.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:22.777 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-22T22:20:22.778 INFO:teuthology.run_tasks:Running task install... 2019-12-22T22:20:22.788 DEBUG:teuthology.task.install:project ceph 2019-12-22T22:20:22.789 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '99b509ffd4dd354919b08b38ba83b998fbfdc107'}} 2019-12-22T22:20:22.789 DEBUG:teuthology.task.install:config {'sha1': '99b509ffd4dd354919b08b38ba83b998fbfdc107', 'extra_packages': ['librados2', 'python-rados', 'python-rbd', 'python-cephfs'], 'branch': 'jewel', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-mgr', 'libcephfs2', 'libcephfs-devel', 'libcephfs-dev', 'ceph-immutable-object-cache', 'ceph-base', 'librados-devel', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs']} 2019-12-22T22:20:22.789 INFO:teuthology.task.install:Using flavor: basic 2019-12-22T22:20:22.802 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-fuse', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2019-12-22T22:20:22.803 INFO:teuthology.task.install:extra packages: ['librados2', 'python-rados', 'python-rbd', 'python-cephfs'] 2019-12-22T22:20:22.803 INFO:teuthology.orchestra.run.smithi168:> sudo lsb_release -is 2019-12-22T22:20:22.977 INFO:teuthology.orchestra.run.smithi168.stdout:CentOS 2019-12-22T22:20:22.979 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-22T22:20:22.979 INFO:teuthology.orchestra.run.smithi071:> sudo lsb_release -is 2019-12-22T22:20:22.980 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '99b509ffd4dd354919b08b38ba83b998fbfdc107', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-mgr', 'libcephfs2', 'libcephfs-devel', 'libcephfs-dev', 'ceph-immutable-object-cache', 'ceph-base', 'librados-devel', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': ['librados2', 'python-rados', 'python-rbd', 'python-cephfs'], 'branch': 'jewel', 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2019-12-22T22:20:22.980 INFO:teuthology.orchestra.run.smithi168:> sudo lsb_release -is 2019-12-22T22:20:23.123 INFO:teuthology.orchestra.run.smithi168.stdout:CentOS 2019-12-22T22:20:23.125 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-22T22:20:23.125 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T22:20:23.125 INFO:teuthology.packaging:ref: None 2019-12-22T22:20:23.125 INFO:teuthology.packaging:tag: None 2019-12-22T22:20:23.125 INFO:teuthology.packaging:branch: jewel 2019-12-22T22:20:23.125 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:20:23.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=jewel 2019-12-22T22:20:23.150 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS 2019-12-22T22:20:23.159 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-22T22:20:23.159 INFO:teuthology.orchestra.run.smithi187:> sudo lsb_release -is 2019-12-22T22:20:23.160 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '99b509ffd4dd354919b08b38ba83b998fbfdc107', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-mgr', 'libcephfs2', 'libcephfs-devel', 'libcephfs-dev', 'ceph-immutable-object-cache', 'ceph-base', 'librados-devel', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': ['librados2', 'python-rados', 'python-rbd', 'python-cephfs'], 'branch': 'jewel', 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2019-12-22T22:20:23.160 INFO:teuthology.orchestra.run.smithi071:> sudo lsb_release -is 2019-12-22T22:20:23.291 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS 2019-12-22T22:20:23.294 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-22T22:20:23.295 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T22:20:23.295 INFO:teuthology.packaging:ref: None 2019-12-22T22:20:23.295 INFO:teuthology.packaging:tag: None 2019-12-22T22:20:23.295 INFO:teuthology.packaging:branch: jewel 2019-12-22T22:20:23.295 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:20:23.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=jewel 2019-12-22T22:20:23.313 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS 2019-12-22T22:20:23.315 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-22T22:20:23.315 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '99b509ffd4dd354919b08b38ba83b998fbfdc107', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-mgr', 'libcephfs2', 'libcephfs-devel', 'libcephfs-dev', 'ceph-immutable-object-cache', 'ceph-base', 'librados-devel', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': ['librados2', 'python-rados', 'python-rbd', 'python-cephfs'], 'branch': 'jewel', 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2019-12-22T22:20:23.315 INFO:teuthology.orchestra.run.smithi187:> sudo lsb_release -is 2019-12-22T22:20:23.427 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS 2019-12-22T22:20:23.429 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-22T22:20:23.430 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T22:20:23.430 INFO:teuthology.packaging:ref: None 2019-12-22T22:20:23.430 INFO:teuthology.packaging:tag: None 2019-12-22T22:20:23.430 INFO:teuthology.packaging:branch: jewel 2019-12-22T22:20:23.430 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:20:23.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=jewel 2019-12-22T22:20:23.507 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/jewel/115560ff830f0bd11db8d0adb66b390924a584f0/centos/7/flavors/default/ 2019-12-22T22:20:23.508 INFO:teuthology.task.install.rpm:Package version is 10.2.11-18.g115560f 2019-12-22T22:20:23.599 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/jewel/115560ff830f0bd11db8d0adb66b390924a584f0/centos/7/flavors/default/ 2019-12-22T22:20:23.600 INFO:teuthology.task.install.rpm:Package version is 10.2.11-18.g115560f 2019-12-22T22:20:23.641 INFO:teuthology.orchestra.run.smithi168:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-22T22:20:23.720 INFO:teuthology.orchestra.run.smithi071:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-22T22:20:23.745 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/jewel/115560ff830f0bd11db8d0adb66b390924a584f0/centos/7/flavors/default/ 2019-12-22T22:20:23.745 INFO:teuthology.task.install.rpm:Package version is 10.2.11-18.g115560f 2019-12-22T22:20:23.764 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-fuse, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, librados2, python-rados, python-rbd, python-cephfs on remote rpm x86_64 2019-12-22T22:20:23.764 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T22:20:23.765 INFO:teuthology.packaging:ref: None 2019-12-22T22:20:23.765 INFO:teuthology.packaging:tag: None 2019-12-22T22:20:23.765 INFO:teuthology.packaging:branch: jewel 2019-12-22T22:20:23.765 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:20:23.765 INFO:teuthology.orchestra.run.smithi168:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/jewel/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-22T22:20:23.842 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-fuse, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, librados2, python-rados, python-rbd, python-cephfs on remote rpm x86_64 2019-12-22T22:20:23.842 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T22:20:23.842 INFO:teuthology.packaging:ref: None 2019-12-22T22:20:23.842 INFO:teuthology.packaging:tag: None 2019-12-22T22:20:23.843 INFO:teuthology.packaging:branch: jewel 2019-12-22T22:20:23.843 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:20:23.843 INFO:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/jewel/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-22T22:20:23.863 INFO:teuthology.orchestra.run.smithi187:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-22T22:20:23.875 INFO:teuthology.orchestra.run.smithi168:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-22T22:20:23.942 INFO:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-22T22:20:23.988 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-fuse, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, librados2, python-rados, python-rbd, python-cephfs on remote rpm x86_64 2019-12-22T22:20:23.988 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T22:20:23.989 INFO:teuthology.packaging:ref: None 2019-12-22T22:20:23.989 INFO:teuthology.packaging:tag: None 2019-12-22T22:20:23.989 INFO:teuthology.packaging:branch: jewel 2019-12-22T22:20:23.989 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:20:23.989 INFO:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/jewel/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-22T22:20:23.994 INFO:teuthology.orchestra.run.smithi168:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-22T22:20:24.041 INFO:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-22T22:20:24.074 INFO:teuthology.orchestra.run.smithi168.stdout:check_obsoletes = 1 2019-12-22T22:20:24.076 INFO:teuthology.orchestra.run.smithi168:> sudo yum clean all 2019-12-22T22:20:24.093 INFO:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-22T22:20:24.112 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2019-12-22T22:20:24.114 INFO:teuthology.orchestra.run.smithi071:> sudo yum clean all 2019-12-22T22:20:24.198 INFO:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-22T22:20:24.265 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:20:24.267 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:20:24.270 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2019-12-22T22:20:24.271 INFO:teuthology.orchestra.run.smithi187:> sudo yum clean all 2019-12-22T22:20:24.308 INFO:teuthology.orchestra.run.smithi168.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-22T22:20:24.308 INFO:teuthology.orchestra.run.smithi168.stdout: : lab-extras updates 2019-12-22T22:20:24.326 INFO:teuthology.orchestra.run.smithi071.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-22T22:20:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: : lab-extras updates 2019-12-22T22:20:24.354 INFO:teuthology.orchestra.run.smithi168.stdout:Cleaning up list of fastest mirrors 2019-12-22T22:20:24.355 INFO:teuthology.orchestra.run.smithi168.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-22T22:20:24.368 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install ceph-radosgw 2019-12-22T22:20:24.384 INFO:teuthology.orchestra.run.smithi071.stdout:Cleaning up list of fastest mirrors 2019-12-22T22:20:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-22T22:20:24.400 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw 2019-12-22T22:20:24.446 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:20:24.485 INFO:teuthology.orchestra.run.smithi187.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-22T22:20:24.485 INFO:teuthology.orchestra.run.smithi187.stdout: : lab-extras updates 2019-12-22T22:20:24.531 INFO:teuthology.orchestra.run.smithi187.stdout:Cleaning up list of fastest mirrors 2019-12-22T22:20:24.532 INFO:teuthology.orchestra.run.smithi187.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-22T22:20:24.544 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw 2019-12-22T22:20:24.604 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:20:24.609 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:20:24.645 INFO:teuthology.orchestra.run.smithi168.stdout:Determining fastest mirrors 2019-12-22T22:20:24.648 INFO:teuthology.orchestra.run.smithi071.stdout:Determining fastest mirrors 2019-12-22T22:20:24.717 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:20:24.754 INFO:teuthology.orchestra.run.smithi187.stdout:Determining fastest mirrors 2019-12-22T22:20:25.289 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:20:25.289 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:20:25.290 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:20:25.290 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:20:25.332 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:20:25.333 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:20:25.333 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:20:25.334 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:20:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:20:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:20:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:20:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:20:32.931 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:20:33.008 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:20:33.168 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:20:33.287 INFO:teuthology.orchestra.run.smithi168.stdout:Resolving Dependencies 2019-12-22T22:20:33.288 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:20:33.288 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph-radosgw.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.295 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: ceph-selinux = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.360 INFO:teuthology.orchestra.run.smithi071.stdout:Resolving Dependencies 2019-12-22T22:20:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:20:33.361 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph-radosgw.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.367 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: ceph-selinux = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.402 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: librados2 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.404 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: librgw2 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.409 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: ceph-common = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.409 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-flask for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.410 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: librgw.so.2()(64bit) for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.410 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:20:33.410 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph-common.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.418 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-cephfs = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.449 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-rbd = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.449 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-rados = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.449 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: librbd1 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.449 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libcephfs1 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.450 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-requests for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.450 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libboost_regex-mt.so.1.53.0()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.450 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.450 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libboost_program_options-mt.so.1.53.0()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.451 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.451 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.451 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph-selinux.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.451 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: ceph-base = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.452 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: ceph-base = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.452 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-22T22:20:33.452 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package librados2.x86_64 2:10.2.11-18.g115560f.el7 will be an update 2019-12-22T22:20:33.452 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.452 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package librgw2.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.453 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-flask.noarch 1:0.10.1-4.el7 will be installed 2019-12-22T22:20:33.453 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-werkzeug for package: 1:python-flask-0.10.1-4.el7.noarch 2019-12-22T22:20:33.453 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-jinja2 for package: 1:python-flask-0.10.1-4.el7.noarch 2019-12-22T22:20:33.453 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-itsdangerous for package: 1:python-flask-0.10.1-4.el7.noarch 2019-12-22T22:20:33.454 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:20:33.454 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package boost-program-options.x86_64 0:1.53.0-27.el7 will be installed 2019-12-22T22:20:33.454 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package boost-regex.x86_64 0:1.53.0-27.el7 will be installed 2019-12-22T22:20:33.454 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libicuuc.so.50()(64bit) for package: boost-regex-1.53.0-27.el7.x86_64 2019-12-22T22:20:33.455 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libicui18n.so.50()(64bit) for package: boost-regex-1.53.0-27.el7.x86_64 2019-12-22T22:20:33.455 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libicudata.so.50()(64bit) for package: boost-regex-1.53.0-27.el7.x86_64 2019-12-22T22:20:33.455 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph-base.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.457 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: hdparm for package: 2:ceph-base-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.457 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-22T22:20:33.457 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package libcephfs1.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.457 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package libradosstriper1.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.458 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-22T22:20:33.458 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package librbd1.x86_64 2:10.2.11-18.g115560f.el7 will be an update 2019-12-22T22:20:33.459 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-22T22:20:33.459 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-22T22:20:33.459 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-22T22:20:33.460 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-cephfs.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.461 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-itsdangerous.noarch 0:0.23-2.el7 will be installed 2019-12-22T22:20:33.461 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-jinja2.noarch 0:2.7.2-4.el7 will be installed 2019-12-22T22:20:33.461 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-babel >= 0.8 for package: python-jinja2-2.7.2-4.el7.noarch 2019-12-22T22:20:33.462 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-markupsafe for package: python-jinja2-2.7.2-4.el7.noarch 2019-12-22T22:20:33.462 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-rados.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.462 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-rbd.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.463 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-requests.noarch 0:2.6.0-8.el7_7 will be installed 2019-12-22T22:20:33.463 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-8.el7_7.noarch 2019-12-22T22:20:33.464 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-22T22:20:33.464 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:20:33.464 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package hdparm.x86_64 0:9.43-5.el7 will be installed 2019-12-22T22:20:33.464 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package libicu.x86_64 0:50.2-3.el7 will be installed 2019-12-22T22:20:33.465 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-babel.noarch 0:0.9.6-8.el7 will be installed 2019-12-22T22:20:33.465 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-22T22:20:33.465 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-22T22:20:33.466 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-22T22:20:33.473 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: librados2 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: librgw2 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.476 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: ceph-common = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.477 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-flask for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.478 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: librgw.so.2()(64bit) for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:20:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph-common.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.489 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-cephfs = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-rbd = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.490 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-rados = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.491 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: librbd1 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libcephfs1 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.494 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-requests for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libboost_regex-mt.so.1.53.0()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.498 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libboost_program_options-mt.so.1.53.0()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.500 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.501 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph-selinux.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.504 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: ceph-base = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.505 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: ceph-base = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-22T22:20:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package librados2.x86_64 2:10.2.11-18.g115560f.el7 will be an update 2019-12-22T22:20:33.508 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.509 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package librgw2.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.512 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-flask.noarch 1:0.10.1-4.el7 will be installed 2019-12-22T22:20:33.512 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-werkzeug for package: 1:python-flask-0.10.1-4.el7.noarch 2019-12-22T22:20:33.514 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-jinja2 for package: 1:python-flask-0.10.1-4.el7.noarch 2019-12-22T22:20:33.515 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-itsdangerous for package: 1:python-flask-0.10.1-4.el7.noarch 2019-12-22T22:20:33.515 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:20:33.515 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package boost-program-options.x86_64 0:1.53.0-27.el7 will be installed 2019-12-22T22:20:33.515 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package boost-regex.x86_64 0:1.53.0-27.el7 will be installed 2019-12-22T22:20:33.515 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libicuuc.so.50()(64bit) for package: boost-regex-1.53.0-27.el7.x86_64 2019-12-22T22:20:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libicui18n.so.50()(64bit) for package: boost-regex-1.53.0-27.el7.x86_64 2019-12-22T22:20:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libicudata.so.50()(64bit) for package: boost-regex-1.53.0-27.el7.x86_64 2019-12-22T22:20:33.518 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph-base.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.523 INFO:teuthology.orchestra.run.smithi187.stdout:Resolving Dependencies 2019-12-22T22:20:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: hdparm for package: 2:ceph-base-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.525 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:20:33.525 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph-radosgw.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-22T22:20:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package libcephfs1.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.530 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package libradosstriper1.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-22T22:20:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package librbd1.x86_64 2:10.2.11-18.g115560f.el7 will be an update 2019-12-22T22:20:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-22T22:20:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-22T22:20:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-22T22:20:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-cephfs.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.532 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: ceph-selinux = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-itsdangerous.noarch 0:0.23-2.el7 will be installed 2019-12-22T22:20:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-jinja2.noarch 0:2.7.2-4.el7 will be installed 2019-12-22T22:20:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-babel >= 0.8 for package: python-jinja2-2.7.2-4.el7.noarch 2019-12-22T22:20:33.533 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-markupsafe for package: python-jinja2-2.7.2-4.el7.noarch 2019-12-22T22:20:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-rados.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-rbd.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.534 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-requests.noarch 0:2.6.0-8.el7_7 will be installed 2019-12-22T22:20:33.535 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-8.el7_7.noarch 2019-12-22T22:20:33.536 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-22T22:20:33.536 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:20:33.536 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package hdparm.x86_64 0:9.43-5.el7 will be installed 2019-12-22T22:20:33.537 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package libicu.x86_64 0:50.2-3.el7 will be installed 2019-12-22T22:20:33.537 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-babel.noarch 0:0.9.6-8.el7 will be installed 2019-12-22T22:20:33.537 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-22T22:20:33.537 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-22T22:20:33.538 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-22T22:20:33.639 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: librados2 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.639 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: librgw2 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.641 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: ceph-common = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.642 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-flask for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.643 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: librgw.so.2()(64bit) for package: 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.643 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:20:33.644 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph-common.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.654 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-cephfs = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.655 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-rbd = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.655 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-rados = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.656 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: librbd1 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.660 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libcephfs1 = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.660 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-requests for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.661 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libboost_regex-mt.so.1.53.0()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.662 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.663 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libboost_program_options-mt.so.1.53.0()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.665 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.669 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.669 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph-selinux.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.669 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: ceph-base = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.671 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: ceph-base = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.675 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-22T22:20:33.676 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package librados2.x86_64 2:10.2.11-18.g115560f.el7 will be an update 2019-12-22T22:20:33.676 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:librados2-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.676 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package librgw2.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.677 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-flask.noarch 1:0.10.1-4.el7 will be installed 2019-12-22T22:20:33.677 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-werkzeug for package: 1:python-flask-0.10.1-4.el7.noarch 2019-12-22T22:20:33.678 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-jinja2 for package: 1:python-flask-0.10.1-4.el7.noarch 2019-12-22T22:20:33.679 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-itsdangerous for package: 1:python-flask-0.10.1-4.el7.noarch 2019-12-22T22:20:33.679 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:20:33.680 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package boost-program-options.x86_64 0:1.53.0-27.el7 will be installed 2019-12-22T22:20:33.680 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package boost-regex.x86_64 0:1.53.0-27.el7 will be installed 2019-12-22T22:20:33.680 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libicuuc.so.50()(64bit) for package: boost-regex-1.53.0-27.el7.x86_64 2019-12-22T22:20:33.682 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libicui18n.so.50()(64bit) for package: boost-regex-1.53.0-27.el7.x86_64 2019-12-22T22:20:33.683 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libicudata.so.50()(64bit) for package: boost-regex-1.53.0-27.el7.x86_64 2019-12-22T22:20:33.683 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph-base.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.689 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: hdparm for package: 2:ceph-base-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:20:33.690 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-22T22:20:33.690 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package libcephfs1.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.691 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package libradosstriper1.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.692 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-22T22:20:33.695 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package librbd1.x86_64 2:10.2.11-18.g115560f.el7 will be an update 2019-12-22T22:20:33.695 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-22T22:20:33.695 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-22T22:20:33.696 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-22T22:20:33.696 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-cephfs.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.697 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-itsdangerous.noarch 0:0.23-2.el7 will be installed 2019-12-22T22:20:33.698 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-jinja2.noarch 0:2.7.2-4.el7 will be installed 2019-12-22T22:20:33.698 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-babel >= 0.8 for package: python-jinja2-2.7.2-4.el7.noarch 2019-12-22T22:20:33.698 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-markupsafe for package: python-jinja2-2.7.2-4.el7.noarch 2019-12-22T22:20:33.699 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-rados.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.699 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-rbd.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:20:33.699 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-requests.noarch 0:2.6.0-8.el7_7 will be installed 2019-12-22T22:20:33.699 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-8.el7_7.noarch 2019-12-22T22:20:33.702 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-22T22:20:33.703 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:20:33.703 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package hdparm.x86_64 0:9.43-5.el7 will be installed 2019-12-22T22:20:33.703 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package libicu.x86_64 0:50.2-3.el7 will be installed 2019-12-22T22:20:33.703 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-babel.noarch 0:0.9.6-8.el7 will be installed 2019-12-22T22:20:33.703 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-22T22:20:33.703 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-22T22:20:33.704 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-22T22:20:34.340 INFO:teuthology.orchestra.run.smithi168.stdout:--> Finished Dependency Resolution 2019-12-22T22:20:34.403 INFO:teuthology.orchestra.run.smithi071.stdout:--> Finished Dependency Resolution 2019-12-22T22:20:34.426 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:20:34.426 INFO:teuthology.orchestra.run.smithi168.stdout:Dependencies Resolved 2019-12-22T22:20:34.430 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:20:34.430 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:20:34.430 INFO:teuthology.orchestra.run.smithi168.stdout: Package Arch Version Repository 2019-12-22T22:20:34.430 INFO:teuthology.orchestra.run.smithi168.stdout: Size 2019-12-22T22:20:34.430 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:20:34.430 INFO:teuthology.orchestra.run.smithi168.stdout:Installing: 2019-12-22T22:20:34.431 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-radosgw x86_64 2:10.2.11-18.g115560f.el7 ceph 266 k 2019-12-22T22:20:34.431 INFO:teuthology.orchestra.run.smithi168.stdout:Installing for dependencies: 2019-12-22T22:20:34.431 INFO:teuthology.orchestra.run.smithi168.stdout: boost-program-options x86_64 1.53.0-27.el7 base 156 k 2019-12-22T22:20:34.431 INFO:teuthology.orchestra.run.smithi168.stdout: boost-regex x86_64 1.53.0-27.el7 base 300 k 2019-12-22T22:20:34.431 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-base x86_64 2:10.2.11-18.g115560f.el7 ceph 4.2 M 2019-12-22T22:20:34.431 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-common x86_64 2:10.2.11-18.g115560f.el7 ceph 17 M 2019-12-22T22:20:34.431 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-selinux x86_64 2:10.2.11-18.g115560f.el7 ceph 19 k 2019-12-22T22:20:34.432 INFO:teuthology.orchestra.run.smithi168.stdout: hdparm x86_64 9.43-5.el7 base 83 k 2019-12-22T22:20:34.432 INFO:teuthology.orchestra.run.smithi168.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-22T22:20:34.432 INFO:teuthology.orchestra.run.smithi168.stdout: libcephfs1 x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 M 2019-12-22T22:20:34.432 INFO:teuthology.orchestra.run.smithi168.stdout: libicu x86_64 50.2-3.el7 base 6.9 M 2019-12-22T22:20:34.432 INFO:teuthology.orchestra.run.smithi168.stdout: libradosstriper1 x86_64 2:10.2.11-18.g115560f.el7 ceph 1.8 M 2019-12-22T22:20:34.432 INFO:teuthology.orchestra.run.smithi168.stdout: librgw2 x86_64 2:10.2.11-18.g115560f.el7 ceph 3.0 M 2019-12-22T22:20:34.432 INFO:teuthology.orchestra.run.smithi168.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-22T22:20:34.433 INFO:teuthology.orchestra.run.smithi168.stdout: python-babel noarch 0.9.6-8.el7 base 1.4 M 2019-12-22T22:20:34.433 INFO:teuthology.orchestra.run.smithi168.stdout: python-cephfs x86_64 2:10.2.11-18.g115560f.el7 ceph 77 k 2019-12-22T22:20:34.433 INFO:teuthology.orchestra.run.smithi168.stdout: python-flask noarch 1:0.10.1-4.el7 extras 204 k 2019-12-22T22:20:34.433 INFO:teuthology.orchestra.run.smithi168.stdout: python-itsdangerous noarch 0.23-2.el7 extras 24 k 2019-12-22T22:20:34.433 INFO:teuthology.orchestra.run.smithi168.stdout: python-jinja2 noarch 2.7.2-4.el7 base 519 k 2019-12-22T22:20:34.433 INFO:teuthology.orchestra.run.smithi168.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-22T22:20:34.433 INFO:teuthology.orchestra.run.smithi168.stdout: python-rados x86_64 2:10.2.11-18.g115560f.el7 ceph 147 k 2019-12-22T22:20:34.434 INFO:teuthology.orchestra.run.smithi168.stdout: python-rbd x86_64 2:10.2.11-18.g115560f.el7 ceph 78 k 2019-12-22T22:20:34.434 INFO:teuthology.orchestra.run.smithi168.stdout: python-requests noarch 2.6.0-8.el7_7 updates 95 k 2019-12-22T22:20:34.434 INFO:teuthology.orchestra.run.smithi168.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-22T22:20:34.434 INFO:teuthology.orchestra.run.smithi168.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-22T22:20:34.434 INFO:teuthology.orchestra.run.smithi168.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-22T22:20:34.434 INFO:teuthology.orchestra.run.smithi168.stdout:Updating for dependencies: 2019-12-22T22:20:34.434 INFO:teuthology.orchestra.run.smithi168.stdout: librados2 x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 M 2019-12-22T22:20:34.435 INFO:teuthology.orchestra.run.smithi168.stdout: librbd1 x86_64 2:10.2.11-18.g115560f.el7 ceph 2.5 M 2019-12-22T22:20:34.435 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:20:34.435 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction Summary 2019-12-22T22:20:34.435 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:20:34.435 INFO:teuthology.orchestra.run.smithi168.stdout:Install 1 Package (+24 Dependent packages) 2019-12-22T22:20:34.435 INFO:teuthology.orchestra.run.smithi168.stdout:Upgrade ( 2 Dependent packages) 2019-12-22T22:20:34.435 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:20:34.436 INFO:teuthology.orchestra.run.smithi168.stdout:Total download size: 43 M 2019-12-22T22:20:34.436 INFO:teuthology.orchestra.run.smithi168.stdout:Downloading packages: 2019-12-22T22:20:34.436 INFO:teuthology.orchestra.run.smithi168.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-22T22:20:34.491 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:20:34.491 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies Resolved 2019-12-22T22:20:34.495 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:20:34.495 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:20:34.495 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository 2019-12-22T22:20:34.495 INFO:teuthology.orchestra.run.smithi071.stdout: Size 2019-12-22T22:20:34.495 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:20:34.495 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2019-12-22T22:20:34.496 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:10.2.11-18.g115560f.el7 ceph 266 k 2019-12-22T22:20:34.496 INFO:teuthology.orchestra.run.smithi071.stdout:Installing for dependencies: 2019-12-22T22:20:34.496 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.53.0-27.el7 base 156 k 2019-12-22T22:20:34.496 INFO:teuthology.orchestra.run.smithi071.stdout: boost-regex x86_64 1.53.0-27.el7 base 300 k 2019-12-22T22:20:34.496 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:10.2.11-18.g115560f.el7 ceph 4.2 M 2019-12-22T22:20:34.496 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:10.2.11-18.g115560f.el7 ceph 17 M 2019-12-22T22:20:34.496 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:10.2.11-18.g115560f.el7 ceph 19 k 2019-12-22T22:20:34.497 INFO:teuthology.orchestra.run.smithi071.stdout: hdparm x86_64 9.43-5.el7 base 83 k 2019-12-22T22:20:34.497 INFO:teuthology.orchestra.run.smithi071.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-22T22:20:34.497 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs1 x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 M 2019-12-22T22:20:34.497 INFO:teuthology.orchestra.run.smithi071.stdout: libicu x86_64 50.2-3.el7 base 6.9 M 2019-12-22T22:20:34.497 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:10.2.11-18.g115560f.el7 ceph 1.8 M 2019-12-22T22:20:34.497 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:10.2.11-18.g115560f.el7 ceph 3.0 M 2019-12-22T22:20:34.497 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-22T22:20:34.498 INFO:teuthology.orchestra.run.smithi071.stdout: python-babel noarch 0.9.6-8.el7 base 1.4 M 2019-12-22T22:20:34.498 INFO:teuthology.orchestra.run.smithi071.stdout: python-cephfs x86_64 2:10.2.11-18.g115560f.el7 ceph 77 k 2019-12-22T22:20:34.498 INFO:teuthology.orchestra.run.smithi071.stdout: python-flask noarch 1:0.10.1-4.el7 extras 204 k 2019-12-22T22:20:34.498 INFO:teuthology.orchestra.run.smithi071.stdout: python-itsdangerous noarch 0.23-2.el7 extras 24 k 2019-12-22T22:20:34.498 INFO:teuthology.orchestra.run.smithi071.stdout: python-jinja2 noarch 2.7.2-4.el7 base 519 k 2019-12-22T22:20:34.498 INFO:teuthology.orchestra.run.smithi071.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-22T22:20:34.498 INFO:teuthology.orchestra.run.smithi071.stdout: python-rados x86_64 2:10.2.11-18.g115560f.el7 ceph 147 k 2019-12-22T22:20:34.499 INFO:teuthology.orchestra.run.smithi071.stdout: python-rbd x86_64 2:10.2.11-18.g115560f.el7 ceph 78 k 2019-12-22T22:20:34.499 INFO:teuthology.orchestra.run.smithi071.stdout: python-requests noarch 2.6.0-8.el7_7 updates 95 k 2019-12-22T22:20:34.499 INFO:teuthology.orchestra.run.smithi071.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-22T22:20:34.499 INFO:teuthology.orchestra.run.smithi071.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-22T22:20:34.499 INFO:teuthology.orchestra.run.smithi071.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-22T22:20:34.499 INFO:teuthology.orchestra.run.smithi071.stdout:Updating for dependencies: 2019-12-22T22:20:34.499 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 M 2019-12-22T22:20:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:10.2.11-18.g115560f.el7 ceph 2.5 M 2019-12-22T22:20:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:20:34.500 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2019-12-22T22:20:34.500 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:20:34.500 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package (+24 Dependent packages) 2019-12-22T22:20:34.500 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade ( 2 Dependent packages) 2019-12-22T22:20:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:20:34.501 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 43 M 2019-12-22T22:20:34.501 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading packages: 2019-12-22T22:20:34.501 INFO:teuthology.orchestra.run.smithi071.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-22T22:20:34.568 INFO:teuthology.orchestra.run.smithi187.stdout:--> Finished Dependency Resolution 2019-12-22T22:20:34.653 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:20:34.654 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies Resolved 2019-12-22T22:20:34.657 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:20:34.658 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:20:34.658 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository 2019-12-22T22:20:34.658 INFO:teuthology.orchestra.run.smithi187.stdout: Size 2019-12-22T22:20:34.658 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:20:34.658 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2019-12-22T22:20:34.658 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:10.2.11-18.g115560f.el7 ceph 266 k 2019-12-22T22:20:34.658 INFO:teuthology.orchestra.run.smithi187.stdout:Installing for dependencies: 2019-12-22T22:20:34.659 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options x86_64 1.53.0-27.el7 base 156 k 2019-12-22T22:20:34.659 INFO:teuthology.orchestra.run.smithi187.stdout: boost-regex x86_64 1.53.0-27.el7 base 300 k 2019-12-22T22:20:34.659 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:10.2.11-18.g115560f.el7 ceph 4.2 M 2019-12-22T22:20:34.659 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:10.2.11-18.g115560f.el7 ceph 17 M 2019-12-22T22:20:34.659 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:10.2.11-18.g115560f.el7 ceph 19 k 2019-12-22T22:20:34.659 INFO:teuthology.orchestra.run.smithi187.stdout: hdparm x86_64 9.43-5.el7 base 83 k 2019-12-22T22:20:34.659 INFO:teuthology.orchestra.run.smithi187.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-22T22:20:34.660 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs1 x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 M 2019-12-22T22:20:34.660 INFO:teuthology.orchestra.run.smithi187.stdout: libicu x86_64 50.2-3.el7 base 6.9 M 2019-12-22T22:20:34.660 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:10.2.11-18.g115560f.el7 ceph 1.8 M 2019-12-22T22:20:34.660 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:10.2.11-18.g115560f.el7 ceph 3.0 M 2019-12-22T22:20:34.662 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-22T22:20:34.662 INFO:teuthology.orchestra.run.smithi187.stdout: python-babel noarch 0.9.6-8.el7 base 1.4 M 2019-12-22T22:20:34.662 INFO:teuthology.orchestra.run.smithi187.stdout: python-cephfs x86_64 2:10.2.11-18.g115560f.el7 ceph 77 k 2019-12-22T22:20:34.663 INFO:teuthology.orchestra.run.smithi187.stdout: python-flask noarch 1:0.10.1-4.el7 extras 204 k 2019-12-22T22:20:34.663 INFO:teuthology.orchestra.run.smithi187.stdout: python-itsdangerous noarch 0.23-2.el7 extras 24 k 2019-12-22T22:20:34.663 INFO:teuthology.orchestra.run.smithi187.stdout: python-jinja2 noarch 2.7.2-4.el7 base 519 k 2019-12-22T22:20:34.663 INFO:teuthology.orchestra.run.smithi187.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-22T22:20:34.663 INFO:teuthology.orchestra.run.smithi187.stdout: python-rados x86_64 2:10.2.11-18.g115560f.el7 ceph 147 k 2019-12-22T22:20:34.664 INFO:teuthology.orchestra.run.smithi187.stdout: python-rbd x86_64 2:10.2.11-18.g115560f.el7 ceph 78 k 2019-12-22T22:20:34.665 INFO:teuthology.orchestra.run.smithi187.stdout: python-requests noarch 2.6.0-8.el7_7 updates 95 k 2019-12-22T22:20:34.666 INFO:teuthology.orchestra.run.smithi187.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-22T22:20:34.667 INFO:teuthology.orchestra.run.smithi187.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-22T22:20:34.667 INFO:teuthology.orchestra.run.smithi187.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-22T22:20:34.667 INFO:teuthology.orchestra.run.smithi187.stdout:Updating for dependencies: 2019-12-22T22:20:34.667 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 M 2019-12-22T22:20:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:10.2.11-18.g115560f.el7 ceph 2.5 M 2019-12-22T22:20:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:20:34.670 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2019-12-22T22:20:34.671 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:20:34.671 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package (+24 Dependent packages) 2019-12-22T22:20:34.672 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade ( 2 Dependent packages) 2019-12-22T22:20:34.673 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:20:34.673 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 43 M 2019-12-22T22:20:34.673 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading packages: 2019-12-22T22:20:34.674 INFO:teuthology.orchestra.run.smithi187.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-22T22:20:37.920 INFO:teuthology.orchestra.run.smithi168.stdout:-------------------------------------------------------------------------------- 2019-12-22T22:20:37.920 INFO:teuthology.orchestra.run.smithi168.stdout:Total 12 MB/s | 43 MB 00:03 2019-12-22T22:20:37.953 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction check 2019-12-22T22:20:38.027 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction test 2019-12-22T22:20:38.362 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction test succeeded 2019-12-22T22:20:38.362 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction 2019-12-22T22:20:39.263 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:libcephfs1-10.2.11-18.g115560f.el7.x86_64 1/29 2019-12-22T22:20:39.644 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 2/29 2019-12-22T22:20:40.228 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 3/29 2019-12-22T22:20:40.561 INFO:teuthology.orchestra.run.smithi168.stdout: Updating : 2:librados2-10.2.11-18.g115560f.el7.x86_64 4/29 2019-12-22T22:20:40.734 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2019-12-22T22:20:40.735 INFO:teuthology.orchestra.run.smithi187.stdout:Total 7.1 MB/s | 43 MB 00:06 2019-12-22T22:20:40.767 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2019-12-22T22:20:40.840 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2019-12-22T22:20:41.184 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded 2019-12-22T22:20:41.185 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2019-12-22T22:20:41.206 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:python-rados-10.2.11-18.g115560f.el7.x86_64 5/29 2019-12-22T22:20:41.321 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2019-12-22T22:20:41.322 INFO:teuthology.orchestra.run.smithi071.stdout:Total 6.3 MB/s | 43 MB 00:06 2019-12-22T22:20:41.341 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2019-12-22T22:20:41.389 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2019-12-22T22:20:41.688 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded 2019-12-22T22:20:41.689 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2019-12-22T22:20:41.824 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:librgw2-10.2.11-18.g115560f.el7.x86_64 6/29 2019-12-22T22:20:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:libcephfs1-10.2.11-18.g115560f.el7.x86_64 1/29 2019-12-22T22:20:42.173 INFO:teuthology.orchestra.run.smithi168.stdout: Updating : 2:librbd1-10.2.11-18.g115560f.el7.x86_64 7/29 2019-12-22T22:20:42.392 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:python-rbd-10.2.11-18.g115560f.el7.x86_64 8/29 2019-12-22T22:20:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:libcephfs1-10.2.11-18.g115560f.el7.x86_64 1/29 2019-12-22T22:20:42.563 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 2/29 2019-12-22T22:20:42.882 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 2/29 2019-12-22T22:20:42.930 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:python-cephfs-10.2.11-18.g115560f.el7.x86_64 9/29 2019-12-22T22:20:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 3/29 2019-12-22T22:20:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 3/29 2019-12-22T22:20:43.557 INFO:teuthology.orchestra.run.smithi187.stdout: Updating : 2:librados2-10.2.11-18.g115560f.el7.x86_64 4/29 2019-12-22T22:20:43.849 INFO:teuthology.orchestra.run.smithi071.stdout: Updating : 2:librados2-10.2.11-18.g115560f.el7.x86_64 4/29 2019-12-22T22:20:43.954 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:libradosstriper1-10.2.11-18.g115560f.el7.x86_64 10/29 2019-12-22T22:20:44.148 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:python-rados-10.2.11-18.g115560f.el7.x86_64 5/29 2019-12-22T22:20:44.300 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : libicu-50.2-3.el7.x86_64 11/29 2019-12-22T22:20:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:python-rados-10.2.11-18.g115560f.el7.x86_64 5/29 2019-12-22T22:20:44.726 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:librgw2-10.2.11-18.g115560f.el7.x86_64 6/29 2019-12-22T22:20:44.808 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : boost-regex-1.53.0-27.el7.x86_64 12/29 2019-12-22T22:20:45.070 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:librgw2-10.2.11-18.g115560f.el7.x86_64 6/29 2019-12-22T22:20:45.101 INFO:teuthology.orchestra.run.smithi187.stdout: Updating : 2:librbd1-10.2.11-18.g115560f.el7.x86_64 7/29 2019-12-22T22:20:45.370 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:python-rbd-10.2.11-18.g115560f.el7.x86_64 8/29 2019-12-22T22:20:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: Updating : 2:librbd1-10.2.11-18.g115560f.el7.x86_64 7/29 2019-12-22T22:20:45.513 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 13/29 2019-12-22T22:20:45.706 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:python-rbd-10.2.11-18.g115560f.el7.x86_64 8/29 2019-12-22T22:20:45.904 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : python-babel-0.9.6-8.el7.noarch 14/29 2019-12-22T22:20:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:python-cephfs-10.2.11-18.g115560f.el7.x86_64 9/29 2019-12-22T22:20:46.190 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : boost-program-options-1.53.0-27.el7.x86_64 15/29 2019-12-22T22:20:46.238 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:python-cephfs-10.2.11-18.g115560f.el7.x86_64 9/29 2019-12-22T22:20:46.414 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : python-itsdangerous-0.23-2.el7.noarch 16/29 2019-12-22T22:20:46.897 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 17/29 2019-12-22T22:20:46.953 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:libradosstriper1-10.2.11-18.g115560f.el7.x86_64 10/29 2019-12-22T22:20:47.303 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:libradosstriper1-10.2.11-18.g115560f.el7.x86_64 10/29 2019-12-22T22:20:47.333 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libicu-50.2-3.el7.x86_64 11/29 2019-12-22T22:20:47.393 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : python-jinja2-2.7.2-4.el7.noarch 18/29 2019-12-22T22:20:47.656 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libicu-50.2-3.el7.x86_64 11/29 2019-12-22T22:20:47.763 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 1:python-flask-0.10.1-4.el7.noarch 19/29 2019-12-22T22:20:47.849 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : boost-regex-1.53.0-27.el7.x86_64 12/29 2019-12-22T22:20:48.133 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 20/29 2019-12-22T22:20:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-regex-1.53.0-27.el7.x86_64 12/29 2019-12-22T22:20:48.405 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 21/29 2019-12-22T22:20:48.541 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 13/29 2019-12-22T22:20:48.824 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 13/29 2019-12-22T22:20:48.930 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python-babel-0.9.6-8.el7.noarch 14/29 2019-12-22T22:20:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python-babel-0.9.6-8.el7.noarch 14/29 2019-12-22T22:20:49.227 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : boost-program-options-1.53.0-27.el7.x86_64 15/29 2019-12-22T22:20:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.53.0-27.el7.x86_64 15/29 2019-12-22T22:20:49.509 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python-itsdangerous-0.23-2.el7.noarch 16/29 2019-12-22T22:20:49.737 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python-itsdangerous-0.23-2.el7.noarch 16/29 2019-12-22T22:20:49.969 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 17/29 2019-12-22T22:20:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 17/29 2019-12-22T22:20:50.413 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python-jinja2-2.7.2-4.el7.noarch 18/29 2019-12-22T22:20:50.649 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : python-requests-2.6.0-8.el7_7.noarch 22/29 2019-12-22T22:20:50.662 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python-jinja2-2.7.2-4.el7.noarch 18/29 2019-12-22T22:20:50.808 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 1:python-flask-0.10.1-4.el7.noarch 19/29 2019-12-22T22:20:51.000 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 23/29 2019-12-22T22:20:51.053 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 1:python-flask-0.10.1-4.el7.noarch 19/29 2019-12-22T22:20:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 20/29 2019-12-22T22:20:51.437 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 20/29 2019-12-22T22:20:51.477 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 21/29 2019-12-22T22:20:51.788 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 21/29 2019-12-22T22:20:51.886 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : hdparm-9.43-5.el7.x86_64 24/29 2019-12-22T22:20:52.340 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-base-10.2.11-18.g115560f.el7.x86_64 25/29 2019-12-22T22:20:53.802 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python-requests-2.6.0-8.el7_7.noarch 22/29 2019-12-22T22:20:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python-requests-2.6.0-8.el7_7.noarch 22/29 2019-12-22T22:20:54.107 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 23/29 2019-12-22T22:20:54.367 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 23/29 2019-12-22T22:20:54.980 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : hdparm-9.43-5.el7.x86_64 24/29 2019-12-22T22:20:55.257 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : hdparm-9.43-5.el7.x86_64 24/29 2019-12-22T22:20:55.478 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-base-10.2.11-18.g115560f.el7.x86_64 25/29 2019-12-22T22:20:55.748 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-base-10.2.11-18.g115560f.el7.x86_64 25/29 2019-12-22T22:21:00.857 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 26/29 2019-12-22T22:21:01.242 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 27/29 2019-12-22T22:21:01.491 INFO:teuthology.orchestra.run.smithi168.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 28/29 2019-12-22T22:21:01.805 INFO:teuthology.orchestra.run.smithi168.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 29/29 2019-12-22T22:21:01.941 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 1:python-flask-0.10.1-4.el7.noarch 1/29 2019-12-22T22:21:02.066 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2/29 2019-12-22T22:21:03.127 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:librados2-10.2.11-18.g115560f.el7.x86_64 3/29 2019-12-22T22:21:03.217 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:python-rados-10.2.11-18.g115560f.el7.x86_64 4/29 2019-12-22T22:21:03.301 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : boost-regex-1.53.0-27.el7.x86_64 5/29 2019-12-22T22:21:03.410 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:librgw2-10.2.11-18.g115560f.el7.x86_64 6/29 2019-12-22T22:21:03.510 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:librbd1-10.2.11-18.g115560f.el7.x86_64 7/29 2019-12-22T22:21:03.653 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : hdparm-9.43-5.el7.x86_64 8/29 2019-12-22T22:21:03.770 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 9/29 2019-12-22T22:21:03.862 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 10/29 2019-12-22T22:21:03.977 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 11/29 2019-12-22T22:21:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 26/29 2019-12-22T22:21:04.080 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/29 2019-12-22T22:21:04.140 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 26/29 2019-12-22T22:21:04.189 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:python-rbd-10.2.11-18.g115560f.el7.x86_64 13/29 2019-12-22T22:21:04.339 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : python-itsdangerous-0.23-2.el7.noarch 14/29 2019-12-22T22:21:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 27/29 2019-12-22T22:21:04.432 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-base-10.2.11-18.g115560f.el7.x86_64 15/29 2019-12-22T22:21:04.541 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : python-jinja2-2.7.2-4.el7.noarch 16/29 2019-12-22T22:21:04.602 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 27/29 2019-12-22T22:21:04.641 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:python-cephfs-10.2.11-18.g115560f.el7.x86_64 17/29 2019-12-22T22:21:04.647 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 28/29 2019-12-22T22:21:04.775 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : boost-program-options-1.53.0-27.el7.x86_64 18/29 2019-12-22T22:21:04.868 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 28/29 2019-12-22T22:21:04.911 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 19/29 2019-12-22T22:21:04.959 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 29/29 2019-12-22T22:21:05.026 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : python-babel-0.9.6-8.el7.noarch 20/29 2019-12-22T22:21:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 1:python-flask-0.10.1-4.el7.noarch 1/29 2019-12-22T22:21:05.110 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 21/29 2019-12-22T22:21:05.156 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 29/29 2019-12-22T22:21:05.202 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 22/29 2019-12-22T22:21:05.213 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2/29 2019-12-22T22:21:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 1:python-flask-0.10.1-4.el7.noarch 1/29 2019-12-22T22:21:05.302 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:libcephfs1-10.2.11-18.g115560f.el7.x86_64 23/29 2019-12-22T22:21:05.322 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:librados2-10.2.11-18.g115560f.el7.x86_64 3/29 2019-12-22T22:21:05.395 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-radosgw-10.2.11-18.g115560f.el7.x86_64 2/29 2019-12-22T22:21:05.411 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:libradosstriper1-10.2.11-18.g115560f.el7.x86_64 24/29 2019-12-22T22:21:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:python-rados-10.2.11-18.g115560f.el7.x86_64 4/29 2019-12-22T22:21:05.487 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:librados2-10.2.11-18.g115560f.el7.x86_64 3/29 2019-12-22T22:21:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : boost-regex-1.53.0-27.el7.x86_64 5/29 2019-12-22T22:21:05.561 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : python-requests-2.6.0-8.el7_7.noarch 25/29 2019-12-22T22:21:05.572 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:python-rados-10.2.11-18.g115560f.el7.x86_64 4/29 2019-12-22T22:21:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-regex-1.53.0-27.el7.x86_64 5/29 2019-12-22T22:21:05.671 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : libicu-50.2-3.el7.x86_64 26/29 2019-12-22T22:21:05.682 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:librgw2-10.2.11-18.g115560f.el7.x86_64 6/29 2019-12-22T22:21:05.763 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 27/29 2019-12-22T22:21:05.764 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 28/29 2019-12-22T22:21:05.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:librbd1-10.2.11-18.g115560f.el7.x86_64 7/29 2019-12-22T22:21:05.772 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:librgw2-10.2.11-18.g115560f.el7.x86_64 6/29 2019-12-22T22:21:05.865 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:librbd1-10.2.11-18.g115560f.el7.x86_64 7/29 2019-12-22T22:21:05.867 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : hdparm-9.43-5.el7.x86_64 8/29 2019-12-22T22:21:05.958 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 9/29 2019-12-22T22:21:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : hdparm-9.43-5.el7.x86_64 8/29 2019-12-22T22:21:06.076 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 10/29 2019-12-22T22:21:06.116 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-selinux-10.2.11-18.g115560f.el7.x86_64 9/29 2019-12-22T22:21:06.146 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 29/29 2019-12-22T22:21:06.146 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:06.147 INFO:teuthology.orchestra.run.smithi168.stdout:Installed: 2019-12-22T22:21:06.147 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-radosgw.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.147 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:06.147 INFO:teuthology.orchestra.run.smithi168.stdout:Dependency Installed: 2019-12-22T22:21:06.147 INFO:teuthology.orchestra.run.smithi168.stdout: boost-program-options.x86_64 0:1.53.0-27.el7 2019-12-22T22:21:06.148 INFO:teuthology.orchestra.run.smithi168.stdout: boost-regex.x86_64 0:1.53.0-27.el7 2019-12-22T22:21:06.148 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-base.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.148 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-common.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.148 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-selinux.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.148 INFO:teuthology.orchestra.run.smithi168.stdout: hdparm.x86_64 0:9.43-5.el7 2019-12-22T22:21:06.148 INFO:teuthology.orchestra.run.smithi168.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-22T22:21:06.148 INFO:teuthology.orchestra.run.smithi168.stdout: libcephfs1.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.149 INFO:teuthology.orchestra.run.smithi168.stdout: libicu.x86_64 0:50.2-3.el7 2019-12-22T22:21:06.149 INFO:teuthology.orchestra.run.smithi168.stdout: libradosstriper1.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.149 INFO:teuthology.orchestra.run.smithi168.stdout: librgw2.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.149 INFO:teuthology.orchestra.run.smithi168.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-22T22:21:06.149 INFO:teuthology.orchestra.run.smithi168.stdout: python-babel.noarch 0:0.9.6-8.el7 2019-12-22T22:21:06.149 INFO:teuthology.orchestra.run.smithi168.stdout: python-cephfs.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.149 INFO:teuthology.orchestra.run.smithi168.stdout: python-flask.noarch 1:0.10.1-4.el7 2019-12-22T22:21:06.150 INFO:teuthology.orchestra.run.smithi168.stdout: python-itsdangerous.noarch 0:0.23-2.el7 2019-12-22T22:21:06.150 INFO:teuthology.orchestra.run.smithi168.stdout: python-jinja2.noarch 0:2.7.2-4.el7 2019-12-22T22:21:06.150 INFO:teuthology.orchestra.run.smithi168.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-22T22:21:06.150 INFO:teuthology.orchestra.run.smithi168.stdout: python-rados.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.150 INFO:teuthology.orchestra.run.smithi168.stdout: python-rbd.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.150 INFO:teuthology.orchestra.run.smithi168.stdout: python-requests.noarch 0:2.6.0-8.el7_7 2019-12-22T22:21:06.150 INFO:teuthology.orchestra.run.smithi168.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-22T22:21:06.151 INFO:teuthology.orchestra.run.smithi168.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-22T22:21:06.151 INFO:teuthology.orchestra.run.smithi168.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-22T22:21:06.151 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:06.151 INFO:teuthology.orchestra.run.smithi168.stdout:Dependency Updated: 2019-12-22T22:21:06.151 INFO:teuthology.orchestra.run.smithi168.stdout: librados2.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.151 INFO:teuthology.orchestra.run.smithi168.stdout: librbd1.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:06.151 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:06.152 INFO:teuthology.orchestra.run.smithi168.stdout:Complete! 2019-12-22T22:21:06.160 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 11/29 2019-12-22T22:21:06.216 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 10/29 2019-12-22T22:21:06.252 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/29 2019-12-22T22:21:06.280 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install ceph-test 2019-12-22T22:21:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 11/29 2019-12-22T22:21:06.360 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:python-rbd-10.2.11-18.g115560f.el7.x86_64 13/29 2019-12-22T22:21:06.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/29 2019-12-22T22:21:06.486 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python-itsdangerous-0.23-2.el7.noarch 14/29 2019-12-22T22:21:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:python-rbd-10.2.11-18.g115560f.el7.x86_64 13/29 2019-12-22T22:21:06.578 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-base-10.2.11-18.g115560f.el7.x86_64 15/29 2019-12-22T22:21:06.579 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:06.624 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:06.624 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:06.624 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:06.624 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:06.625 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python-itsdangerous-0.23-2.el7.noarch 14/29 2019-12-22T22:21:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python-jinja2-2.7.2-4.el7.noarch 16/29 2019-12-22T22:21:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-base-10.2.11-18.g115560f.el7.x86_64 15/29 2019-12-22T22:21:06.812 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:python-cephfs-10.2.11-18.g115560f.el7.x86_64 17/29 2019-12-22T22:21:06.861 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python-jinja2-2.7.2-4.el7.noarch 16/29 2019-12-22T22:21:06.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : boost-program-options-1.53.0-27.el7.x86_64 18/29 2019-12-22T22:21:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:python-cephfs-10.2.11-18.g115560f.el7.x86_64 17/29 2019-12-22T22:21:07.047 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 19/29 2019-12-22T22:21:07.062 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.53.0-27.el7.x86_64 18/29 2019-12-22T22:21:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-common-10.2.11-18.g115560f.el7.x86_64 19/29 2019-12-22T22:21:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python-babel-0.9.6-8.el7.noarch 20/29 2019-12-22T22:21:07.280 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python-babel-0.9.6-8.el7.noarch 20/29 2019-12-22T22:21:07.283 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 21/29 2019-12-22T22:21:07.373 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 21/29 2019-12-22T22:21:07.423 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 22/29 2019-12-22T22:21:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 22/29 2019-12-22T22:21:07.507 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:libcephfs1-10.2.11-18.g115560f.el7.x86_64 23/29 2019-12-22T22:21:07.591 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:libradosstriper1-10.2.11-18.g115560f.el7.x86_64 24/29 2019-12-22T22:21:07.619 INFO:teuthology.orchestra.run.smithi168.stdout:Resolving Dependencies 2019-12-22T22:21:07.620 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:21:07.620 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph-test.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:07.624 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:libcephfs1-10.2.11-18.g115560f.el7.x86_64 23/29 2019-12-22T22:21:07.637 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:07.667 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:07.668 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:21:07.668 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-22T22:21:07.669 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-22T22:21:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python-requests-2.6.0-8.el7_7.noarch 25/29 2019-12-22T22:21:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:libradosstriper1-10.2.11-18.g115560f.el7.x86_64 24/29 2019-12-22T22:21:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libicu-50.2-3.el7.x86_64 26/29 2019-12-22T22:21:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python-requests-2.6.0-8.el7_7.noarch 25/29 2019-12-22T22:21:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 27/29 2019-12-22T22:21:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 28/29 2019-12-22T22:21:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libicu-50.2-3.el7.x86_64 26/29 2019-12-22T22:21:08.035 INFO:teuthology.orchestra.run.smithi168.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:08.076 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 27/29 2019-12-22T22:21:08.077 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 28/29 2019-12-22T22:21:08.262 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:08.263 INFO:teuthology.orchestra.run.smithi168.stdout:Dependencies Resolved 2019-12-22T22:21:08.264 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:08.264 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:08.264 INFO:teuthology.orchestra.run.smithi168.stdout: Package Arch Version Repository Size 2019-12-22T22:21:08.265 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:08.265 INFO:teuthology.orchestra.run.smithi168.stdout:Installing: 2019-12-22T22:21:08.265 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-test x86_64 2:10.2.11-18.g115560f.el7 ceph 73 M 2019-12-22T22:21:08.265 INFO:teuthology.orchestra.run.smithi168.stdout:Installing for dependencies: 2019-12-22T22:21:08.265 INFO:teuthology.orchestra.run.smithi168.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-22T22:21:08.266 INFO:teuthology.orchestra.run.smithi168.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-22T22:21:08.266 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:08.266 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction Summary 2019-12-22T22:21:08.266 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:08.266 INFO:teuthology.orchestra.run.smithi168.stdout:Install 1 Package (+2 Dependent packages) 2019-12-22T22:21:08.267 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:08.267 INFO:teuthology.orchestra.run.smithi168.stdout:Total download size: 73 M 2019-12-22T22:21:08.267 INFO:teuthology.orchestra.run.smithi168.stdout:Installed size: 283 M 2019-12-22T22:21:08.267 INFO:teuthology.orchestra.run.smithi168.stdout:Downloading packages: 2019-12-22T22:21:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 29/29 2019-12-22T22:21:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:08.317 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2019-12-22T22:21:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:08.318 INFO:teuthology.orchestra.run.smithi187.stdout:Dependency Installed: 2019-12-22T22:21:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options.x86_64 0:1.53.0-27.el7 2019-12-22T22:21:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: boost-regex.x86_64 0:1.53.0-27.el7 2019-12-22T22:21:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: hdparm.x86_64 0:9.43-5.el7 2019-12-22T22:21:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-22T22:21:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs1.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: libicu.x86_64 0:50.2-3.el7 2019-12-22T22:21:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-22T22:21:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: python-babel.noarch 0:0.9.6-8.el7 2019-12-22T22:21:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: python-cephfs.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: python-flask.noarch 1:0.10.1-4.el7 2019-12-22T22:21:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: python-itsdangerous.noarch 0:0.23-2.el7 2019-12-22T22:21:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: python-jinja2.noarch 0:2.7.2-4.el7 2019-12-22T22:21:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-22T22:21:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: python-rados.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: python-rbd.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: python-requests.noarch 0:2.6.0-8.el7_7 2019-12-22T22:21:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-22T22:21:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-22T22:21:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-22T22:21:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:08.322 INFO:teuthology.orchestra.run.smithi187.stdout:Dependency Updated: 2019-12-22T22:21:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: librados2.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:08.323 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2019-12-22T22:21:08.448 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-test 2019-12-22T22:21:08.467 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 29/29 2019-12-22T22:21:08.467 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2019-12-22T22:21:08.468 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.468 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:08.468 INFO:teuthology.orchestra.run.smithi071.stdout:Dependency Installed: 2019-12-22T22:21:08.468 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options.x86_64 0:1.53.0-27.el7 2019-12-22T22:21:08.468 INFO:teuthology.orchestra.run.smithi071.stdout: boost-regex.x86_64 0:1.53.0-27.el7 2019-12-22T22:21:08.468 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.469 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.469 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.469 INFO:teuthology.orchestra.run.smithi071.stdout: hdparm.x86_64 0:9.43-5.el7 2019-12-22T22:21:08.469 INFO:teuthology.orchestra.run.smithi071.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-22T22:21:08.469 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs1.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.469 INFO:teuthology.orchestra.run.smithi071.stdout: libicu.x86_64 0:50.2-3.el7 2019-12-22T22:21:08.469 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.470 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.470 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-22T22:21:08.470 INFO:teuthology.orchestra.run.smithi071.stdout: python-babel.noarch 0:0.9.6-8.el7 2019-12-22T22:21:08.471 INFO:teuthology.orchestra.run.smithi071.stdout: python-cephfs.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.471 INFO:teuthology.orchestra.run.smithi071.stdout: python-flask.noarch 1:0.10.1-4.el7 2019-12-22T22:21:08.472 INFO:teuthology.orchestra.run.smithi071.stdout: python-itsdangerous.noarch 0:0.23-2.el7 2019-12-22T22:21:08.472 INFO:teuthology.orchestra.run.smithi071.stdout: python-jinja2.noarch 0:2.7.2-4.el7 2019-12-22T22:21:08.472 INFO:teuthology.orchestra.run.smithi071.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-22T22:21:08.472 INFO:teuthology.orchestra.run.smithi071.stdout: python-rados.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.472 INFO:teuthology.orchestra.run.smithi071.stdout: python-rbd.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.472 INFO:teuthology.orchestra.run.smithi071.stdout: python-requests.noarch 0:2.6.0-8.el7_7 2019-12-22T22:21:08.472 INFO:teuthology.orchestra.run.smithi071.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-22T22:21:08.473 INFO:teuthology.orchestra.run.smithi071.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-22T22:21:08.473 INFO:teuthology.orchestra.run.smithi071.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-22T22:21:08.473 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:08.473 INFO:teuthology.orchestra.run.smithi071.stdout:Dependency Updated: 2019-12-22T22:21:08.473 INFO:teuthology.orchestra.run.smithi071.stdout: librados2.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.473 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:08.474 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2019-12-22T22:21:08.598 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-test 2019-12-22T22:21:08.720 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:08.757 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:08.892 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:08.935 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:09.414 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:09.580 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:09.747 INFO:teuthology.orchestra.run.smithi187.stdout:Resolving Dependencies 2019-12-22T22:21:09.747 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:21:09.747 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph-test.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:09.765 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:09.795 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:09.796 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:21:09.796 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-22T22:21:09.796 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-22T22:21:09.911 INFO:teuthology.orchestra.run.smithi071.stdout:Resolving Dependencies 2019-12-22T22:21:09.912 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:21:09.912 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph-test.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:09.929 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:09.958 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:09.959 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:21:09.960 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-22T22:21:09.960 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-22T22:21:10.161 INFO:teuthology.orchestra.run.smithi187.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:10.326 INFO:teuthology.orchestra.run.smithi071.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:10.387 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:10.388 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies Resolved 2019-12-22T22:21:10.388 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:10.388 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:10.389 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2019-12-22T22:21:10.389 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:10.389 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2019-12-22T22:21:10.389 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:10.2.11-18.g115560f.el7 ceph 73 M 2019-12-22T22:21:10.389 INFO:teuthology.orchestra.run.smithi187.stdout:Installing for dependencies: 2019-12-22T22:21:10.389 INFO:teuthology.orchestra.run.smithi187.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-22T22:21:10.389 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-22T22:21:10.390 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:10.390 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2019-12-22T22:21:10.390 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:10.390 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package (+2 Dependent packages) 2019-12-22T22:21:10.390 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:10.390 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 73 M 2019-12-22T22:21:10.390 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 283 M 2019-12-22T22:21:10.391 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading packages: 2019-12-22T22:21:10.547 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:10.547 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies Resolved 2019-12-22T22:21:10.548 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:10.548 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:10.548 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2019-12-22T22:21:10.548 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:10.548 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2019-12-22T22:21:10.548 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:10.2.11-18.g115560f.el7 ceph 73 M 2019-12-22T22:21:10.549 INFO:teuthology.orchestra.run.smithi071.stdout:Installing for dependencies: 2019-12-22T22:21:10.549 INFO:teuthology.orchestra.run.smithi071.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-22T22:21:10.549 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-22T22:21:10.549 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:10.549 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2019-12-22T22:21:10.549 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:10.549 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package (+2 Dependent packages) 2019-12-22T22:21:10.550 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:10.550 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 73 M 2019-12-22T22:21:10.550 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 283 M 2019-12-22T22:21:10.550 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading packages: 2019-12-22T22:21:11.422 INFO:teuthology.orchestra.run.smithi168.stdout:-------------------------------------------------------------------------------- 2019-12-22T22:21:11.422 INFO:teuthology.orchestra.run.smithi168.stdout:Total 23 MB/s | 73 MB 00:03 2019-12-22T22:21:11.424 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction check 2019-12-22T22:21:11.439 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction test 2019-12-22T22:21:11.500 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction test succeeded 2019-12-22T22:21:11.500 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction 2019-12-22T22:21:12.188 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 2019-12-22T22:21:14.186 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2019-12-22T22:21:14.188 INFO:teuthology.orchestra.run.smithi187.stdout:Total 19 MB/s | 73 MB 00:03 2019-12-22T22:21:14.192 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2019-12-22T22:21:14.204 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2019-12-22T22:21:14.256 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded 2019-12-22T22:21:14.256 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2019-12-22T22:21:14.970 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 2019-12-22T22:21:19.298 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2019-12-22T22:21:19.299 INFO:teuthology.orchestra.run.smithi071.stdout:Total 8.4 MB/s | 73 MB 00:08 2019-12-22T22:21:19.300 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2019-12-22T22:21:19.316 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2019-12-22T22:21:19.370 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded 2019-12-22T22:21:19.370 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2019-12-22T22:21:19.671 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 2/3 2019-12-22T22:21:19.958 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 3/3 2019-12-22T22:21:20.078 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 1/3 2019-12-22T22:21:20.245 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 2/3 2019-12-22T22:21:20.252 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/3 2019-12-22T22:21:20.748 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 2019-12-22T22:21:20.748 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:20.748 INFO:teuthology.orchestra.run.smithi168.stdout:Installed: 2019-12-22T22:21:20.748 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-test.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:20.749 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:20.749 INFO:teuthology.orchestra.run.smithi168.stdout:Dependency Installed: 2019-12-22T22:21:20.749 INFO:teuthology.orchestra.run.smithi168.stdout: leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-22T22:21:20.749 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:20.749 INFO:teuthology.orchestra.run.smithi168.stdout:Complete! 2019-12-22T22:21:20.876 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install ceph 2019-12-22T22:21:21.123 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:21.165 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:21.166 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:21.167 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:21.167 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:21.167 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:21.823 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:22.160 INFO:teuthology.orchestra.run.smithi168.stdout:Resolving Dependencies 2019-12-22T22:21:22.161 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:21:22.161 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:22.163 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: ceph-mds = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:22.193 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: ceph-osd = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:22.194 INFO:teuthology.orchestra.run.smithi168.stdout:--> Processing Dependency: ceph-mon = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:22.195 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:21:22.195 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph-mds.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:22.205 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph-mon.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:22.208 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph-osd.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:22.480 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 2/3 2019-12-22T22:21:22.572 INFO:teuthology.orchestra.run.smithi168.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:22.742 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 3/3 2019-12-22T22:21:22.799 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:22.799 INFO:teuthology.orchestra.run.smithi168.stdout:Dependencies Resolved 2019-12-22T22:21:22.801 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:22.801 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:22.801 INFO:teuthology.orchestra.run.smithi168.stdout: Package Arch Version Repository Size 2019-12-22T22:21:22.802 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:22.802 INFO:teuthology.orchestra.run.smithi168.stdout:Installing: 2019-12-22T22:21:22.802 INFO:teuthology.orchestra.run.smithi168.stdout: ceph x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 k 2019-12-22T22:21:22.803 INFO:teuthology.orchestra.run.smithi168.stdout:Installing for dependencies: 2019-12-22T22:21:22.803 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-mds x86_64 2:10.2.11-18.g115560f.el7 ceph 2.8 M 2019-12-22T22:21:22.803 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-mon x86_64 2:10.2.11-18.g115560f.el7 ceph 3.1 M 2019-12-22T22:21:22.803 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-osd x86_64 2:10.2.11-18.g115560f.el7 ceph 9.5 M 2019-12-22T22:21:22.804 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:22.805 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction Summary 2019-12-22T22:21:22.805 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:22.805 INFO:teuthology.orchestra.run.smithi168.stdout:Install 1 Package (+3 Dependent packages) 2019-12-22T22:21:22.806 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:22.806 INFO:teuthology.orchestra.run.smithi168.stdout:Total download size: 15 M 2019-12-22T22:21:22.806 INFO:teuthology.orchestra.run.smithi168.stdout:Installed size: 52 M 2019-12-22T22:21:22.807 INFO:teuthology.orchestra.run.smithi168.stdout:Downloading packages: 2019-12-22T22:21:22.840 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 1/3 2019-12-22T22:21:22.957 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 2/3 2019-12-22T22:21:23.727 INFO:teuthology.orchestra.run.smithi168.stdout:-------------------------------------------------------------------------------- 2019-12-22T22:21:23.727 INFO:teuthology.orchestra.run.smithi168.stdout:Total 17 MB/s | 15 MB 00:00 2019-12-22T22:21:23.730 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction check 2019-12-22T22:21:23.763 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction test 2019-12-22T22:21:23.803 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction test succeeded 2019-12-22T22:21:23.804 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction 2019-12-22T22:21:23.810 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 2019-12-22T22:21:23.810 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:23.811 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2019-12-22T22:21:23.811 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:23.811 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:23.811 INFO:teuthology.orchestra.run.smithi187.stdout:Dependency Installed: 2019-12-22T22:21:23.811 INFO:teuthology.orchestra.run.smithi187.stdout: leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-22T22:21:23.811 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:23.811 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2019-12-22T22:21:23.949 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph 2019-12-22T22:21:24.216 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:24.261 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:24.262 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:24.262 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:24.262 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:24.263 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:24.920 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:25.262 INFO:teuthology.orchestra.run.smithi187.stdout:Resolving Dependencies 2019-12-22T22:21:25.262 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:21:25.262 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:25.265 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: ceph-mds = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:25.295 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: ceph-osd = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:25.296 INFO:teuthology.orchestra.run.smithi187.stdout:--> Processing Dependency: ceph-mon = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:25.297 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:21:25.297 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph-mds.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:25.307 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph-mon.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:25.310 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph-osd.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:25.674 INFO:teuthology.orchestra.run.smithi187.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:25.828 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-osd-10.2.11-18.g115560f.el7.x86_64 1/4 2019-12-22T22:21:25.899 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:25.899 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies Resolved 2019-12-22T22:21:25.901 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:25.901 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:25.901 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2019-12-22T22:21:25.901 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:25.901 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2019-12-22T22:21:25.902 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 k 2019-12-22T22:21:25.902 INFO:teuthology.orchestra.run.smithi187.stdout:Installing for dependencies: 2019-12-22T22:21:25.902 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:10.2.11-18.g115560f.el7 ceph 2.8 M 2019-12-22T22:21:25.902 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:10.2.11-18.g115560f.el7 ceph 3.1 M 2019-12-22T22:21:25.902 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:10.2.11-18.g115560f.el7 ceph 9.5 M 2019-12-22T22:21:25.902 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:25.903 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2019-12-22T22:21:25.903 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:25.903 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package (+3 Dependent packages) 2019-12-22T22:21:25.903 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:25.903 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 15 M 2019-12-22T22:21:25.903 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 52 M 2019-12-22T22:21:25.904 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading packages: 2019-12-22T22:21:26.563 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-mds-10.2.11-18.g115560f.el7.x86_64 2/4 2019-12-22T22:21:26.858 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2019-12-22T22:21:26.858 INFO:teuthology.orchestra.run.smithi187.stdout:Total 16 MB/s | 15 MB 00:00 2019-12-22T22:21:26.861 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2019-12-22T22:21:26.897 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2019-12-22T22:21:26.938 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded 2019-12-22T22:21:26.939 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2019-12-22T22:21:26.965 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-mon-10.2.11-18.g115560f.el7.x86_64 3/4 2019-12-22T22:21:27.182 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-10.2.11-18.g115560f.el7.x86_64 4/4 2019-12-22T22:21:27.322 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-mon-10.2.11-18.g115560f.el7.x86_64 1/4 2019-12-22T22:21:27.406 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-10.2.11-18.g115560f.el7.x86_64 2/4 2019-12-22T22:21:27.515 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-mds-10.2.11-18.g115560f.el7.x86_64 3/4 2019-12-22T22:21:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 2/3 2019-12-22T22:21:27.991 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-osd-10.2.11-18.g115560f.el7.x86_64 4/4 2019-12-22T22:21:27.992 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:27.992 INFO:teuthology.orchestra.run.smithi168.stdout:Installed: 2019-12-22T22:21:27.992 INFO:teuthology.orchestra.run.smithi168.stdout: ceph.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:27.992 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:27.992 INFO:teuthology.orchestra.run.smithi168.stdout:Dependency Installed: 2019-12-22T22:21:27.992 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-mds.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:27.992 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-mon.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:27.993 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-osd.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:27.993 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:27.993 INFO:teuthology.orchestra.run.smithi168.stdout:Complete! 2019-12-22T22:21:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 3/3 2019-12-22T22:21:28.110 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install ceph-fuse 2019-12-22T22:21:28.158 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-test-10.2.11-18.g115560f.el7.x86_64 1/3 2019-12-22T22:21:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 2/3 2019-12-22T22:21:28.318 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:28.356 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:28.356 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:28.357 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:28.357 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:28.358 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:28.735 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 3/3 2019-12-22T22:21:28.735 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:28.736 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2019-12-22T22:21:28.736 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:28.736 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:28.736 INFO:teuthology.orchestra.run.smithi071.stdout:Dependency Installed: 2019-12-22T22:21:28.736 INFO:teuthology.orchestra.run.smithi071.stdout: leveldb.x86_64 0:1.12.0-11.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-22T22:21:28.736 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:28.736 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2019-12-22T22:21:28.865 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph 2019-12-22T22:21:28.987 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:29.102 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:29.140 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:29.142 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:29.142 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:29.142 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:29.317 INFO:teuthology.orchestra.run.smithi168.stdout:Resolving Dependencies 2019-12-22T22:21:29.318 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:21:29.318 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package ceph-fuse.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:29.340 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-osd-10.2.11-18.g115560f.el7.x86_64 1/4 2019-12-22T22:21:29.694 INFO:teuthology.orchestra.run.smithi168.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:29.920 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:29.921 INFO:teuthology.orchestra.run.smithi168.stdout:Dependencies Resolved 2019-12-22T22:21:29.921 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:29.921 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:29.922 INFO:teuthology.orchestra.run.smithi168.stdout: Package Arch Version Repository Size 2019-12-22T22:21:29.922 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:29.922 INFO:teuthology.orchestra.run.smithi168.stdout:Installing: 2019-12-22T22:21:29.922 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-fuse x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 M 2019-12-22T22:21:29.922 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:29.922 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction Summary 2019-12-22T22:21:29.923 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:29.923 INFO:teuthology.orchestra.run.smithi168.stdout:Install 1 Package 2019-12-22T22:21:29.923 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:29.923 INFO:teuthology.orchestra.run.smithi168.stdout:Total download size: 1.9 M 2019-12-22T22:21:29.923 INFO:teuthology.orchestra.run.smithi168.stdout:Installed size: 6.4 M 2019-12-22T22:21:29.923 INFO:teuthology.orchestra.run.smithi168.stdout:Downloading packages: 2019-12-22T22:21:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-mds-10.2.11-18.g115560f.el7.x86_64 2/4 2019-12-22T22:21:30.111 INFO:teuthology.orchestra.run.smithi071.stdout:Resolving Dependencies 2019-12-22T22:21:30.112 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:21:30.112 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:30.114 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: ceph-mds = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: ceph-osd = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout:--> Processing Dependency: ceph-mon = 2:10.2.11-18.g115560f.el7 for package: 2:ceph-10.2.11-18.g115560f.el7.x86_64 2019-12-22T22:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph-mds.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:30.155 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph-mon.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:30.166 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph-osd.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:30.467 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction check 2019-12-22T22:21:30.489 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction test 2019-12-22T22:21:30.493 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction test succeeded 2019-12-22T22:21:30.494 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction 2019-12-22T22:21:30.495 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-mon-10.2.11-18.g115560f.el7.x86_64 3/4 2019-12-22T22:21:30.523 INFO:teuthology.orchestra.run.smithi071.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:30.745 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies Resolved 2019-12-22T22:21:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:30.746 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2019-12-22T22:21:30.746 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:30.746 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2019-12-22T22:21:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 k 2019-12-22T22:21:30.746 INFO:teuthology.orchestra.run.smithi071.stdout:Installing for dependencies: 2019-12-22T22:21:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:10.2.11-18.g115560f.el7 ceph 2.8 M 2019-12-22T22:21:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:10.2.11-18.g115560f.el7 ceph 3.1 M 2019-12-22T22:21:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:10.2.11-18.g115560f.el7 ceph 9.5 M 2019-12-22T22:21:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:30.747 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2019-12-22T22:21:30.747 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:30.747 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package (+3 Dependent packages) 2019-12-22T22:21:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:30.748 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 15 M 2019-12-22T22:21:30.748 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 52 M 2019-12-22T22:21:30.748 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading packages: 2019-12-22T22:21:30.770 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-10.2.11-18.g115560f.el7.x86_64 4/4 2019-12-22T22:21:30.902 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-mon-10.2.11-18.g115560f.el7.x86_64 1/4 2019-12-22T22:21:30.986 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-10.2.11-18.g115560f.el7.x86_64 2/4 2019-12-22T22:21:31.070 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-mds-10.2.11-18.g115560f.el7.x86_64 3/4 2019-12-22T22:21:31.288 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:ceph-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:31.497 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-osd-10.2.11-18.g115560f.el7.x86_64 4/4 2019-12-22T22:21:31.497 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:31.497 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2019-12-22T22:21:31.497 INFO:teuthology.orchestra.run.smithi187.stdout: ceph.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:31.497 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:31.498 INFO:teuthology.orchestra.run.smithi187.stdout:Dependency Installed: 2019-12-22T22:21:31.498 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:31.498 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:31.498 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:31.498 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:31.498 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2019-12-22T22:21:31.628 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-fuse 2019-12-22T22:21:31.828 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:ceph-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:31.839 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:31.839 INFO:teuthology.orchestra.run.smithi168.stdout:Installed: 2019-12-22T22:21:31.839 INFO:teuthology.orchestra.run.smithi168.stdout: ceph-fuse.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:31.839 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:31.839 INFO:teuthology.orchestra.run.smithi168.stdout:Complete! 2019-12-22T22:21:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2019-12-22T22:21:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:Total 14 MB/s | 15 MB 00:01 2019-12-22T22:21:31.879 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2019-12-22T22:21:31.904 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:31.910 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2019-12-22T22:21:31.945 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install librados2 2019-12-22T22:21:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded 2019-12-22T22:21:31.947 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:31.947 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2019-12-22T22:21:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:32.188 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:32.228 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:32.229 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:32.230 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:32.230 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:32.230 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:32.602 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:32.895 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:32.945 INFO:teuthology.orchestra.run.smithi187.stdout:Resolving Dependencies 2019-12-22T22:21:32.946 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:21:32.946 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package ceph-fuse.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:33.229 INFO:teuthology.orchestra.run.smithi168.stdout:Package 2:librados2-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:33.229 INFO:teuthology.orchestra.run.smithi168.stdout:Nothing to do 2019-12-22T22:21:33.291 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install librbd1 2019-12-22T22:21:33.320 INFO:teuthology.orchestra.run.smithi187.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:33.453 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:33.487 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:33.488 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:33.489 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:33.489 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:33.489 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:33.544 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:33.544 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies Resolved 2019-12-22T22:21:33.545 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:33.545 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:33.545 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2019-12-22T22:21:33.545 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:33.545 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2019-12-22T22:21:33.545 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 M 2019-12-22T22:21:33.546 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:33.546 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2019-12-22T22:21:33.546 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:33.546 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2019-12-22T22:21:33.546 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:33.546 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 1.9 M 2019-12-22T22:21:33.546 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 6.4 M 2019-12-22T22:21:33.547 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading packages: 2019-12-22T22:21:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-osd-10.2.11-18.g115560f.el7.x86_64 1/4 2019-12-22T22:21:34.010 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2019-12-22T22:21:34.032 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2019-12-22T22:21:34.032 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded 2019-12-22T22:21:34.033 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2019-12-22T22:21:34.081 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:34.410 INFO:teuthology.orchestra.run.smithi168.stdout:Package 2:librbd1-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:34.410 INFO:teuthology.orchestra.run.smithi168.stdout:Nothing to do 2019-12-22T22:21:34.473 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install rbd-fuse 2019-12-22T22:21:34.666 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:34.705 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:34.706 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:34.707 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:34.707 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:34.707 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:34.743 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-mds-10.2.11-18.g115560f.el7.x86_64 2/4 2019-12-22T22:21:34.794 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:ceph-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:35.179 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-mon-10.2.11-18.g115560f.el7.x86_64 3/4 2019-12-22T22:21:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:ceph-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:35.317 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2019-12-22T22:21:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:35.318 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2019-12-22T22:21:35.362 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:35.413 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-10.2.11-18.g115560f.el7.x86_64 4/4 2019-12-22T22:21:35.435 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install librados2 2019-12-22T22:21:35.537 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-mon-10.2.11-18.g115560f.el7.x86_64 1/4 2019-12-22T22:21:35.621 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-10.2.11-18.g115560f.el7.x86_64 2/4 2019-12-22T22:21:35.643 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:35.683 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:35.690 INFO:teuthology.orchestra.run.smithi168.stdout:Resolving Dependencies 2019-12-22T22:21:35.691 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:21:35.691 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package rbd-fuse.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:35.738 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-mds-10.2.11-18.g115560f.el7.x86_64 3/4 2019-12-22T22:21:36.065 INFO:teuthology.orchestra.run.smithi168.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-osd-10.2.11-18.g115560f.el7.x86_64 4/4 2019-12-22T22:21:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:36.165 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2019-12-22T22:21:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: ceph.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:36.165 INFO:teuthology.orchestra.run.smithi071.stdout:Dependency Installed: 2019-12-22T22:21:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:36.166 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2019-12-22T22:21:36.290 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:36.291 INFO:teuthology.orchestra.run.smithi168.stdout:Dependencies Resolved 2019-12-22T22:21:36.291 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:36.292 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:36.292 INFO:teuthology.orchestra.run.smithi168.stdout: Package Arch Version Repository Size 2019-12-22T22:21:36.292 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:36.292 INFO:teuthology.orchestra.run.smithi168.stdout:Installing: 2019-12-22T22:21:36.292 INFO:teuthology.orchestra.run.smithi168.stdout: rbd-fuse x86_64 2:10.2.11-18.g115560f.el7 ceph 433 k 2019-12-22T22:21:36.292 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:36.293 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction Summary 2019-12-22T22:21:36.293 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:36.293 INFO:teuthology.orchestra.run.smithi168.stdout:Install 1 Package 2019-12-22T22:21:36.293 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:36.293 INFO:teuthology.orchestra.run.smithi168.stdout:Total download size: 433 k 2019-12-22T22:21:36.293 INFO:teuthology.orchestra.run.smithi168.stdout:Installed size: 2.0 M 2019-12-22T22:21:36.293 INFO:teuthology.orchestra.run.smithi168.stdout:Downloading packages: 2019-12-22T22:21:36.295 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-fuse 2019-12-22T22:21:36.329 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:36.565 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:36.607 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:36.608 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:36.609 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:36.609 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:36.609 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:36.661 INFO:teuthology.orchestra.run.smithi187.stdout:Package 2:librados2-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:36.661 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do 2019-12-22T22:21:36.694 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction check 2019-12-22T22:21:36.716 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction test 2019-12-22T22:21:36.718 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction test succeeded 2019-12-22T22:21:36.718 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction 2019-12-22T22:21:36.723 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install librbd1 2019-12-22T22:21:36.933 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:36.977 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:36.977 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:36.978 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:36.978 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:36.978 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:37.248 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:37.316 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:rbd-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:37.593 INFO:teuthology.orchestra.run.smithi071.stdout:Resolving Dependencies 2019-12-22T22:21:37.593 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:21:37.593 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package ceph-fuse.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:37.628 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:37.781 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:rbd-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:37.782 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:37.782 INFO:teuthology.orchestra.run.smithi168.stdout:Installed: 2019-12-22T22:21:37.782 INFO:teuthology.orchestra.run.smithi168.stdout: rbd-fuse.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:37.782 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:37.782 INFO:teuthology.orchestra.run.smithi168.stdout:Complete! 2019-12-22T22:21:37.898 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install rbd-mirror 2019-12-22T22:21:37.963 INFO:teuthology.orchestra.run.smithi071.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:37.970 INFO:teuthology.orchestra.run.smithi187.stdout:Package 2:librbd1-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:37.971 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do 2019-12-22T22:21:38.029 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install rbd-fuse 2019-12-22T22:21:38.132 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:38.170 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:38.171 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:38.172 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:38.172 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:38.172 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:38.182 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies Resolved 2019-12-22T22:21:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:38.183 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2019-12-22T22:21:38.183 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:38.183 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2019-12-22T22:21:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:10.2.11-18.g115560f.el7 ceph 1.9 M 2019-12-22T22:21:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:38.184 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2019-12-22T22:21:38.184 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:38.184 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2019-12-22T22:21:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:38.184 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 1.9 M 2019-12-22T22:21:38.184 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 6.4 M 2019-12-22T22:21:38.184 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading packages: 2019-12-22T22:21:38.190 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:38.224 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:38.225 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:38.225 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:38.226 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:38.226 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:38.661 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2019-12-22T22:21:38.685 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2019-12-22T22:21:38.687 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded 2019-12-22T22:21:38.688 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2019-12-22T22:21:38.814 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:38.820 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:39.143 INFO:teuthology.orchestra.run.smithi187.stdout:Resolving Dependencies 2019-12-22T22:21:39.144 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:21:39.144 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package rbd-fuse.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:39.158 INFO:teuthology.orchestra.run.smithi168.stdout:Resolving Dependencies 2019-12-22T22:21:39.158 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:21:39.158 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package rbd-mirror.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:39.470 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:ceph-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:39.516 INFO:teuthology.orchestra.run.smithi187.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:39.531 INFO:teuthology.orchestra.run.smithi168.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:39.740 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies Resolved 2019-12-22T22:21:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:39.741 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2019-12-22T22:21:39.742 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:39.742 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2019-12-22T22:21:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:10.2.11-18.g115560f.el7 ceph 433 k 2019-12-22T22:21:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:39.742 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2019-12-22T22:21:39.742 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:39.742 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2019-12-22T22:21:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:39.743 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 433 k 2019-12-22T22:21:39.743 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 2.0 M 2019-12-22T22:21:39.743 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading packages: 2019-12-22T22:21:39.757 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:39.757 INFO:teuthology.orchestra.run.smithi168.stdout:Dependencies Resolved 2019-12-22T22:21:39.758 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:39.758 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:39.758 INFO:teuthology.orchestra.run.smithi168.stdout: Package Arch Version Repository Size 2019-12-22T22:21:39.758 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:39.758 INFO:teuthology.orchestra.run.smithi168.stdout:Installing: 2019-12-22T22:21:39.758 INFO:teuthology.orchestra.run.smithi168.stdout: rbd-mirror x86_64 2:10.2.11-18.g115560f.el7 ceph 1.6 M 2019-12-22T22:21:39.759 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:39.759 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction Summary 2019-12-22T22:21:39.759 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:39.759 INFO:teuthology.orchestra.run.smithi168.stdout:Install 1 Package 2019-12-22T22:21:39.759 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:39.759 INFO:teuthology.orchestra.run.smithi168.stdout:Total download size: 1.6 M 2019-12-22T22:21:39.759 INFO:teuthology.orchestra.run.smithi168.stdout:Installed size: 6.3 M 2019-12-22T22:21:39.760 INFO:teuthology.orchestra.run.smithi168.stdout:Downloading packages: 2019-12-22T22:21:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:ceph-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:39.968 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2019-12-22T22:21:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:39.969 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2019-12-22T22:21:40.090 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install librados2 2019-12-22T22:21:40.105 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2019-12-22T22:21:40.118 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2019-12-22T22:21:40.119 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded 2019-12-22T22:21:40.120 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2019-12-22T22:21:40.215 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction check 2019-12-22T22:21:40.235 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction test 2019-12-22T22:21:40.236 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction test succeeded 2019-12-22T22:21:40.237 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction 2019-12-22T22:21:40.350 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:40.394 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:40.395 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:40.396 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:40.396 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:40.396 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:40.738 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:rbd-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:41.047 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:41.090 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:rbd-mirror-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:41.186 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:rbd-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:41.186 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:41.186 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2019-12-22T22:21:41.186 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:41.186 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:41.186 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2019-12-22T22:21:41.320 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install rbd-mirror 2019-12-22T22:21:41.386 INFO:teuthology.orchestra.run.smithi071.stdout:Package 2:librados2-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:41.386 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do 2019-12-22T22:21:41.446 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install librbd1 2019-12-22T22:21:41.578 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:41.584 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:rbd-mirror-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:41.584 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:41.585 INFO:teuthology.orchestra.run.smithi168.stdout:Installed: 2019-12-22T22:21:41.585 INFO:teuthology.orchestra.run.smithi168.stdout: rbd-mirror.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:41.585 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:41.585 INFO:teuthology.orchestra.run.smithi168.stdout:Complete! 2019-12-22T22:21:41.610 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:41.624 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:41.625 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:41.626 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:41.626 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:41.626 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:41.644 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:41.645 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:41.646 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:41.646 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:41.646 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:41.706 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install rbd-nbd 2019-12-22T22:21:41.926 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:41.966 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:41.973 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:41.973 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:41.973 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:41.973 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:42.227 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:42.275 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:42.551 INFO:teuthology.orchestra.run.smithi071.stdout:Package 2:librbd1-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:42.552 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do 2019-12-22T22:21:42.612 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-fuse 2019-12-22T22:21:42.614 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:42.622 INFO:teuthology.orchestra.run.smithi187.stdout:Resolving Dependencies 2019-12-22T22:21:42.622 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:21:42.622 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package rbd-mirror.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:42.857 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:42.902 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:42.903 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:42.903 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:42.904 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:42.904 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:42.943 INFO:teuthology.orchestra.run.smithi168.stdout:Resolving Dependencies 2019-12-22T22:21:42.944 INFO:teuthology.orchestra.run.smithi168.stdout:--> Running transaction check 2019-12-22T22:21:42.944 INFO:teuthology.orchestra.run.smithi168.stdout:---> Package rbd-nbd.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:42.996 INFO:teuthology.orchestra.run.smithi187.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:43.220 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies Resolved 2019-12-22T22:21:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:43.221 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2019-12-22T22:21:43.222 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:43.222 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2019-12-22T22:21:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:10.2.11-18.g115560f.el7 ceph 1.6 M 2019-12-22T22:21:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:43.222 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2019-12-22T22:21:43.222 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:43.223 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2019-12-22T22:21:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:43.223 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 1.6 M 2019-12-22T22:21:43.223 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 6.3 M 2019-12-22T22:21:43.223 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading packages: 2019-12-22T22:21:43.319 INFO:teuthology.orchestra.run.smithi168.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:43.503 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:43.503 INFO:teuthology.orchestra.run.smithi168.stdout:Dependencies Resolved 2019-12-22T22:21:43.504 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:43.504 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:43.504 INFO:teuthology.orchestra.run.smithi168.stdout: Package Arch Version Repository Size 2019-12-22T22:21:43.504 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:43.505 INFO:teuthology.orchestra.run.smithi168.stdout:Installing: 2019-12-22T22:21:43.505 INFO:teuthology.orchestra.run.smithi168.stdout: rbd-nbd x86_64 2:10.2.11-18.g115560f.el7 ceph 474 k 2019-12-22T22:21:43.505 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:43.505 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction Summary 2019-12-22T22:21:43.505 INFO:teuthology.orchestra.run.smithi168.stdout:================================================================================ 2019-12-22T22:21:43.505 INFO:teuthology.orchestra.run.smithi168.stdout:Install 1 Package 2019-12-22T22:21:43.506 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:43.506 INFO:teuthology.orchestra.run.smithi168.stdout:Total download size: 474 k 2019-12-22T22:21:43.506 INFO:teuthology.orchestra.run.smithi168.stdout:Installed size: 2.1 M 2019-12-22T22:21:43.506 INFO:teuthology.orchestra.run.smithi168.stdout:Downloading packages: 2019-12-22T22:21:43.551 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:43.669 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2019-12-22T22:21:43.687 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2019-12-22T22:21:43.688 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded 2019-12-22T22:21:43.689 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2019-12-22T22:21:43.888 INFO:teuthology.orchestra.run.smithi071.stdout:Resolving Dependencies 2019-12-22T22:21:43.891 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:21:43.892 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package rbd-fuse.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:43.899 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction check 2019-12-22T22:21:43.920 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction test 2019-12-22T22:21:43.921 INFO:teuthology.orchestra.run.smithi168.stdout:Transaction test succeeded 2019-12-22T22:21:43.922 INFO:teuthology.orchestra.run.smithi168.stdout:Running transaction 2019-12-22T22:21:44.264 INFO:teuthology.orchestra.run.smithi071.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:44.485 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies Resolved 2019-12-22T22:21:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:44.486 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2019-12-22T22:21:44.486 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:44.486 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2019-12-22T22:21:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:10.2.11-18.g115560f.el7 ceph 433 k 2019-12-22T22:21:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:44.487 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2019-12-22T22:21:44.487 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:44.487 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2019-12-22T22:21:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:44.487 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 433 k 2019-12-22T22:21:44.488 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 2.0 M 2019-12-22T22:21:44.488 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading packages: 2019-12-22T22:21:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:rbd-mirror-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:44.606 INFO:teuthology.orchestra.run.smithi168.stdout: Installing : 2:rbd-nbd-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:44.880 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2019-12-22T22:21:44.899 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2019-12-22T22:21:44.901 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded 2019-12-22T22:21:44.902 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2019-12-22T22:21:45.066 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:rbd-mirror-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:45.066 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:45.066 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2019-12-22T22:21:45.066 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:45.066 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:45.066 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2019-12-22T22:21:45.080 INFO:teuthology.orchestra.run.smithi168.stdout: Verifying : 2:rbd-nbd-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:45.080 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:45.080 INFO:teuthology.orchestra.run.smithi168.stdout:Installed: 2019-12-22T22:21:45.080 INFO:teuthology.orchestra.run.smithi168.stdout: rbd-nbd.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:45.081 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:21:45.081 INFO:teuthology.orchestra.run.smithi168.stdout:Complete! 2019-12-22T22:21:45.181 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install rbd-nbd 2019-12-22T22:21:45.209 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install librados2 2019-12-22T22:21:45.363 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:45.401 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:45.402 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:45.402 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:45.402 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:45.403 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:45.468 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:45.513 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:45.515 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:45.515 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:45.515 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:45.516 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:45.523 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:rbd-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:46.006 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:rbd-fuse-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:46.007 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:46.007 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2019-12-22T22:21:46.007 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:46.007 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:46.007 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2019-12-22T22:21:46.025 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:46.126 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-mirror 2019-12-22T22:21:46.168 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:46.356 INFO:teuthology.orchestra.run.smithi187.stdout:Resolving Dependencies 2019-12-22T22:21:46.356 INFO:teuthology.orchestra.run.smithi187.stdout:--> Running transaction check 2019-12-22T22:21:46.356 INFO:teuthology.orchestra.run.smithi187.stdout:---> Package rbd-nbd.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:46.384 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:46.428 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:46.429 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:46.430 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:46.431 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:46.431 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:46.508 INFO:teuthology.orchestra.run.smithi168.stdout:Package 2:librados2-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:46.509 INFO:teuthology.orchestra.run.smithi168.stdout:Nothing to do 2019-12-22T22:21:46.571 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install python-rados 2019-12-22T22:21:46.729 INFO:teuthology.orchestra.run.smithi187.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:46.749 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:46.786 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:46.787 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:46.787 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:46.787 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:46.788 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:46.912 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies Resolved 2019-12-22T22:21:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:46.913 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2019-12-22T22:21:46.913 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:46.914 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2019-12-22T22:21:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:10.2.11-18.g115560f.el7 ceph 474 k 2019-12-22T22:21:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:46.914 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2019-12-22T22:21:46.914 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2019-12-22T22:21:46.914 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2019-12-22T22:21:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:46.915 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 474 k 2019-12-22T22:21:46.915 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 2.1 M 2019-12-22T22:21:46.915 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading packages: 2019-12-22T22:21:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:47.304 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2019-12-22T22:21:47.327 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2019-12-22T22:21:47.328 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded 2019-12-22T22:21:47.329 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2019-12-22T22:21:47.387 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:47.417 INFO:teuthology.orchestra.run.smithi071.stdout:Resolving Dependencies 2019-12-22T22:21:47.418 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:21:47.418 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package rbd-mirror.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:47.718 INFO:teuthology.orchestra.run.smithi168.stdout:Package 2:python-rados-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:47.719 INFO:teuthology.orchestra.run.smithi168.stdout:Nothing to do 2019-12-22T22:21:47.781 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install python-rbd 2019-12-22T22:21:47.800 INFO:teuthology.orchestra.run.smithi071.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : 2:rbd-nbd-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:47.988 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:48.021 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies Resolved 2019-12-22T22:21:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:48.022 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2019-12-22T22:21:48.022 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:48.022 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2019-12-22T22:21:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:10.2.11-18.g115560f.el7 ceph 1.6 M 2019-12-22T22:21:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:48.022 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2019-12-22T22:21:48.023 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:48.023 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2019-12-22T22:21:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:48.023 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 1.6 M 2019-12-22T22:21:48.023 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 6.3 M 2019-12-22T22:21:48.023 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading packages: 2019-12-22T22:21:48.031 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:48.032 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:48.033 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:48.033 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:48.033 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:48.450 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2019-12-22T22:21:48.474 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2019-12-22T22:21:48.476 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded 2019-12-22T22:21:48.476 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2019-12-22T22:21:48.707 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:49.042 INFO:teuthology.orchestra.run.smithi168.stdout:Package 2:python-rbd-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:49.042 INFO:teuthology.orchestra.run.smithi168.stdout:Nothing to do 2019-12-22T22:21:49.105 INFO:teuthology.orchestra.run.smithi168:> sudo yum -y install python-cephfs 2019-12-22T22:21:49.331 INFO:teuthology.orchestra.run.smithi168.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:49.373 INFO:teuthology.orchestra.run.smithi168.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:49.374 INFO:teuthology.orchestra.run.smithi168.stdout: * base: mirror.facebook.net 2019-12-22T22:21:49.374 INFO:teuthology.orchestra.run.smithi168.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:49.375 INFO:teuthology.orchestra.run.smithi168.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:49.375 INFO:teuthology.orchestra.run.smithi168.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:rbd-mirror-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:49.503 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : 2:rbd-nbd-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:49.503 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:49.503 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2019-12-22T22:21:49.503 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:49.503 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:21:49.504 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2019-12-22T22:21:49.622 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install librados2 2019-12-22T22:21:49.819 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:rbd-mirror-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:49.819 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:49.819 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2019-12-22T22:21:49.820 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:49.820 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:49.820 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2019-12-22T22:21:49.881 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:49.926 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:49.927 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:49.928 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:49.928 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:49.928 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:49.942 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-nbd 2019-12-22T22:21:50.035 INFO:teuthology.orchestra.run.smithi168.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:50.175 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:50.218 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:50.219 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:50.220 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:50.220 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:50.220 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:50.372 INFO:teuthology.orchestra.run.smithi168.stdout:Package 2:python-cephfs-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:50.372 INFO:teuthology.orchestra.run.smithi168.stdout:Nothing to do 2019-12-22T22:21:50.434 DEBUG:teuthology.parallel:result is None 2019-12-22T22:21:50.585 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:50.867 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:50.925 INFO:teuthology.orchestra.run.smithi187.stdout:Package 2:librados2-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:50.925 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do 2019-12-22T22:21:50.985 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install python-rados 2019-12-22T22:21:51.187 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:51.203 INFO:teuthology.orchestra.run.smithi071.stdout:Resolving Dependencies 2019-12-22T22:21:51.204 INFO:teuthology.orchestra.run.smithi071.stdout:--> Running transaction check 2019-12-22T22:21:51.204 INFO:teuthology.orchestra.run.smithi071.stdout:---> Package rbd-nbd.x86_64 2:10.2.11-18.g115560f.el7 will be installed 2019-12-22T22:21:51.223 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:51.575 INFO:teuthology.orchestra.run.smithi071.stdout:--> Finished Dependency Resolution 2019-12-22T22:21:51.755 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:51.755 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies Resolved 2019-12-22T22:21:51.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:51.756 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:51.757 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2019-12-22T22:21:51.757 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:51.757 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2019-12-22T22:21:51.757 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:10.2.11-18.g115560f.el7 ceph 474 k 2019-12-22T22:21:51.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:51.757 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2019-12-22T22:21:51.757 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2019-12-22T22:21:51.757 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2019-12-22T22:21:51.758 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:51.758 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 474 k 2019-12-22T22:21:51.758 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 2.1 M 2019-12-22T22:21:51.758 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading packages: 2019-12-22T22:21:51.817 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:52.145 INFO:teuthology.orchestra.run.smithi187.stdout:Package 2:python-rados-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:52.146 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do 2019-12-22T22:21:52.173 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2019-12-22T22:21:52.193 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2019-12-22T22:21:52.195 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded 2019-12-22T22:21:52.195 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2019-12-22T22:21:52.207 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install python-rbd 2019-12-22T22:21:52.430 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:52.471 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:52.472 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:52.472 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:52.473 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:52.473 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:52.914 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : 2:rbd-nbd-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:53.127 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:53.397 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : 2:rbd-nbd-10.2.11-18.g115560f.el7.x86_64 1/1 2019-12-22T22:21:53.495 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:53.495 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2019-12-22T22:21:53.495 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd.x86_64 2:10.2.11-18.g115560f.el7 2019-12-22T22:21:53.495 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:21:53.496 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2019-12-22T22:21:53.496 INFO:teuthology.orchestra.run.smithi187.stdout:Package 2:python-rbd-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:53.497 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do 2019-12-22T22:21:53.516 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install librados2 2019-12-22T22:21:53.602 INFO:teuthology.orchestra.run.smithi187:> sudo yum -y install python-cephfs 2019-12-22T22:21:53.855 INFO:teuthology.orchestra.run.smithi187.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:53.871 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:53.900 INFO:teuthology.orchestra.run.smithi187.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:53.901 INFO:teuthology.orchestra.run.smithi187.stdout: * base: www.gtlib.gatech.edu 2019-12-22T22:21:53.902 INFO:teuthology.orchestra.run.smithi187.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:53.902 INFO:teuthology.orchestra.run.smithi187.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:53.902 INFO:teuthology.orchestra.run.smithi187.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:53.917 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:53.918 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:53.918 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:53.918 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:53.919 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:54.554 INFO:teuthology.orchestra.run.smithi187.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:54.567 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:54.892 INFO:teuthology.orchestra.run.smithi187.stdout:Package 2:python-cephfs-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:54.892 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do 2019-12-22T22:21:54.907 INFO:teuthology.orchestra.run.smithi071.stdout:Package 2:librados2-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:54.907 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do 2019-12-22T22:21:54.954 DEBUG:teuthology.parallel:result is None 2019-12-22T22:21:54.967 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install python-rados 2019-12-22T22:21:55.138 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:55.173 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:55.173 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:55.174 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:55.174 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:55.174 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:55.762 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:56.087 INFO:teuthology.orchestra.run.smithi071.stdout:Package 2:python-rados-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:56.088 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do 2019-12-22T22:21:56.147 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install python-rbd 2019-12-22T22:21:56.386 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:56.431 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:57.078 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:57.413 INFO:teuthology.orchestra.run.smithi071.stdout:Package 2:python-rbd-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:57.413 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do 2019-12-22T22:21:57.473 INFO:teuthology.orchestra.run.smithi071:> sudo yum -y install python-cephfs 2019-12-22T22:21:57.683 INFO:teuthology.orchestra.run.smithi071.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-22T22:21:57.722 INFO:teuthology.orchestra.run.smithi071.stdout:Loading mirror speeds from cached hostfile 2019-12-22T22:21:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: * base: mirror.facebook.net 2019-12-22T22:21:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-22T22:21:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: * extras: mirror.fileplanet.com 2019-12-22T22:21:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: * updates: repos-va.psychz.net 2019-12-22T22:21:58.368 INFO:teuthology.orchestra.run.smithi071.stdout:11 packages excluded due to repository priority protections 2019-12-22T22:21:58.693 INFO:teuthology.orchestra.run.smithi071.stdout:Package 2:python-cephfs-10.2.11-18.g115560f.el7.x86_64 already installed and latest version 2019-12-22T22:21:58.693 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do 2019-12-22T22:21:58.753 DEBUG:teuthology.parallel:result is None 2019-12-22T22:21:58.753 INFO:teuthology.orchestra.run.smithi168:> sudo lsb_release -is 2019-12-22T22:21:58.900 INFO:teuthology.orchestra.run.smithi168.stdout:CentOS 2019-12-22T22:21:58.902 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-22T22:21:58.903 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T22:21:58.903 INFO:teuthology.packaging:ref: None 2019-12-22T22:21:58.903 INFO:teuthology.packaging:tag: None 2019-12-22T22:21:58.903 INFO:teuthology.packaging:branch: jewel 2019-12-22T22:21:58.903 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:21:58.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=jewel 2019-12-22T22:21:59.251 INFO:teuthology.orchestra.run.smithi168:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-22T22:21:59.387 INFO:teuthology.orchestra.run.smithi168.stdout:10.2.11-18.g115560f.el7 2019-12-22T22:21:59.388 INFO:teuthology.packaging:The installed version of ceph is 10.2.11-18.g115560f.el7 2019-12-22T22:21:59.388 INFO:teuthology.task.install:The correct ceph version 10.2.11-18.g115560f is installed. 2019-12-22T22:21:59.388 INFO:teuthology.orchestra.run.smithi071:> sudo lsb_release -is 2019-12-22T22:21:59.540 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS 2019-12-22T22:21:59.543 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-22T22:21:59.543 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T22:21:59.543 INFO:teuthology.packaging:ref: None 2019-12-22T22:21:59.543 INFO:teuthology.packaging:tag: None 2019-12-22T22:21:59.543 INFO:teuthology.packaging:branch: jewel 2019-12-22T22:21:59.544 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:21:59.544 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=jewel 2019-12-22T22:21:59.871 INFO:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-22T22:21:59.999 INFO:teuthology.orchestra.run.smithi071.stdout:10.2.11-18.g115560f.el7 2019-12-22T22:21:59.999 INFO:teuthology.packaging:The installed version of ceph is 10.2.11-18.g115560f.el7 2019-12-22T22:21:59.999 INFO:teuthology.task.install:The correct ceph version 10.2.11-18.g115560f is installed. 2019-12-22T22:22:00.000 INFO:teuthology.orchestra.run.smithi187:> sudo lsb_release -is 2019-12-22T22:22:00.155 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS 2019-12-22T22:22:00.157 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-22T22:22:00.157 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-22T22:22:00.157 INFO:teuthology.packaging:ref: None 2019-12-22T22:22:00.158 INFO:teuthology.packaging:tag: None 2019-12-22T22:22:00.158 INFO:teuthology.packaging:branch: jewel 2019-12-22T22:22:00.158 INFO:teuthology.packaging:sha1: 99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:22:00.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=jewel 2019-12-22T22:22:00.541 INFO:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-22T22:22:00.674 INFO:teuthology.orchestra.run.smithi187.stdout:10.2.11-18.g115560f.el7 2019-12-22T22:22:00.675 INFO:teuthology.packaging:The installed version of ceph is 10.2.11-18.g115560f.el7 2019-12-22T22:22:00.675 INFO:teuthology.task.install:The correct ceph version 10.2.11-18.g115560f is installed. 2019-12-22T22:22:00.675 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-12-22T22:22:00.681 INFO:teuthology.orchestra.run.smithi168:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-22T22:22:00.800 INFO:teuthology.orchestra.run.smithi071:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-22T22:22:00.912 INFO:teuthology.orchestra.run.smithi187:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-22T22:22:01.034 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-12-22T22:22:01.034 INFO:teuthology.orchestra.run.smithi168:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-22T22:22:01.146 INFO:teuthology.orchestra.run.smithi168:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-22T22:22:01.253 INFO:teuthology.orchestra.run.smithi071:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-22T22:22:01.377 INFO:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-22T22:22:01.473 INFO:teuthology.orchestra.run.smithi187:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-22T22:22:01.593 INFO:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-22T22:22:01.698 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-12-22T22:22:01.698 INFO:teuthology.orchestra.run.smithi168:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-22T22:22:01.814 INFO:teuthology.orchestra.run.smithi168:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-22T22:22:01.915 INFO:teuthology.orchestra.run.smithi071:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-22T22:22:02.038 INFO:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-22T22:22:02.151 INFO:teuthology.orchestra.run.smithi187:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-22T22:22:02.273 INFO:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-22T22:22:02.385 INFO:teuthology.run_tasks:Running task cephadm... 2019-12-22T22:22:02.506 INFO:tasks.cephadm:Config: {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow requests'], 'mon_bind_msgr2': False, 'conf': {'global': {'ms inject delay max': 1, 'ms inject delay type': 'osd', 'osd_pool_default_min_size': 2, 'ms bind msgr2': False, 'ms inject delay probability': 0.005, 'mon client directed command retry': 5, 'ms type': 'async', 'ms inject socket failures': 2500, 'osd_pool_default_size': 3, 'ms inject internal delays': 0.002}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'debug ms': 1, 'mon osdmap full prune min': 15, 'mon osdmap full prune interval': 2, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'osd op queue cut off': 'debug_random', 'debug ms': 1, 'debug journal': 20, 'osd scrub max interval': 120, 'osd max backfills': 6, 'debug osd': 25, 'osd debug verify cached snaps': True, 'osd map cache size': 1, 'osd debug verify missing on start': True, 'osd op queue': 'debug_random', 'osd backoff on peering': True, 'osd scrub min interval': 60, 'debug filestore': 20, 'osd shutdown pgref assert': True, 'osd scrub during recovery': False}}, 'sha1': '99b509ffd4dd354919b08b38ba83b998fbfdc107'} 2019-12-22T22:22:02.507 INFO:tasks.cephadm:Cluster image is quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 2019-12-22T22:22:02.507 INFO:tasks.cephadm:Cluster fsid is 7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:22:02.507 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2019-12-22T22:22:02.508 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '[v1:172.21.15.71:6789]', 'mon.c': '[v1:172.21.15.168:6789]', 'mon.b': '[v1:172.21.15.187:6789]'} 2019-12-22T22:22:02.508 INFO:tasks.cephadm:Normalizing hostnames... 2019-12-22T22:22:02.508 INFO:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2019-12-22T22:22:02.630 INFO:teuthology.orchestra.run.smithi168:> sudo hostname $(hostname -s) 2019-12-22T22:22:02.749 INFO:teuthology.orchestra.run.smithi187:> sudo hostname $(hostname -s) 2019-12-22T22:22:02.872 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref 99b509ffd4dd354919b08b38ba83b998fbfdc107)... 2019-12-22T22:22:02.872 INFO:teuthology.orchestra.run.smithi071:> git archive --remote=git://git.ceph.com/ceph-ci.git 99b509ffd4dd354919b08b38ba83b998fbfdc107 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && test -s /home/ubuntu/cephtest/cephadm && chmod +x /home/ubuntu/cephtest/cephadm 2019-12-22T22:22:03.116 INFO:teuthology.orchestra.run.smithi168:> git archive --remote=git://git.ceph.com/ceph-ci.git 99b509ffd4dd354919b08b38ba83b998fbfdc107 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && test -s /home/ubuntu/cephtest/cephadm && chmod +x /home/ubuntu/cephtest/cephadm 2019-12-22T22:22:03.375 INFO:teuthology.orchestra.run.smithi187:> git archive --remote=git://git.ceph.com/ceph-ci.git 99b509ffd4dd354919b08b38ba83b998fbfdc107 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && test -s /home/ubuntu/cephtest/cephadm && chmod +x /home/ubuntu/cephtest/cephadm 2019-12-22T22:22:03.646 INFO:tasks.cephadm:First mon is mon.a on smithi071 2019-12-22T22:22:03.646 INFO:tasks.cephadm:others ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-22T22:22:03.647 INFO:tasks.cephadm:First mgr is y 2019-12-22T22:22:03.647 INFO:tasks.cephadm:Writing seed config... 2019-12-22T22:22:03.648 INFO:tasks.cephadm: override: [global] ms inject delay max = 1 2019-12-22T22:22:03.648 INFO:tasks.cephadm: override: [global] ms inject delay type = osd 2019-12-22T22:22:03.649 INFO:tasks.cephadm: override: [global] osd_pool_default_min_size = 2 2019-12-22T22:22:03.649 INFO:tasks.cephadm: override: [global] ms bind msgr2 = False 2019-12-22T22:22:03.649 INFO:tasks.cephadm: override: [global] ms inject delay probability = 0.005 2019-12-22T22:22:03.649 INFO:tasks.cephadm: override: [global] mon client directed command retry = 5 2019-12-22T22:22:03.649 INFO:tasks.cephadm: override: [global] ms type = async 2019-12-22T22:22:03.649 INFO:tasks.cephadm: override: [global] ms inject socket failures = 2500 2019-12-22T22:22:03.649 INFO:tasks.cephadm: override: [global] osd_pool_default_size = 3 2019-12-22T22:22:03.650 INFO:tasks.cephadm: override: [global] ms inject internal delays = 0.002 2019-12-22T22:22:03.650 INFO:tasks.cephadm: override: [mon] debug mon = 20 2019-12-22T22:22:03.650 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2019-12-22T22:22:03.650 INFO:tasks.cephadm: override: [mon] mon min osdmap epochs = 50 2019-12-22T22:22:03.650 INFO:tasks.cephadm: override: [mon] debug ms = 1 2019-12-22T22:22:03.650 INFO:tasks.cephadm: override: [mon] mon osdmap full prune min = 15 2019-12-22T22:22:03.650 INFO:tasks.cephadm: override: [mon] mon osdmap full prune interval = 2 2019-12-22T22:22:03.650 INFO:tasks.cephadm: override: [mon] mon osdmap full prune txsize = 2 2019-12-22T22:22:03.651 INFO:tasks.cephadm: override: [mon] paxos service trim min = 10 2019-12-22T22:22:03.651 INFO:tasks.cephadm: override: [osd] osd op queue cut off = debug_random 2019-12-22T22:22:03.651 INFO:tasks.cephadm: override: [osd] debug ms = 1 2019-12-22T22:22:03.651 INFO:tasks.cephadm: override: [osd] debug journal = 20 2019-12-22T22:22:03.651 INFO:tasks.cephadm: override: [osd] osd scrub max interval = 120 2019-12-22T22:22:03.651 INFO:tasks.cephadm: override: [osd] osd max backfills = 6 2019-12-22T22:22:03.651 INFO:tasks.cephadm: override: [osd] debug osd = 25 2019-12-22T22:22:03.651 INFO:tasks.cephadm: override: [osd] osd debug verify cached snaps = True 2019-12-22T22:22:03.652 INFO:tasks.cephadm: override: [osd] osd map cache size = 1 2019-12-22T22:22:03.652 INFO:tasks.cephadm: override: [osd] osd debug verify missing on start = True 2019-12-22T22:22:03.652 INFO:tasks.cephadm: override: [osd] osd op queue = debug_random 2019-12-22T22:22:03.652 INFO:tasks.cephadm: override: [osd] osd backoff on peering = True 2019-12-22T22:22:03.652 INFO:tasks.cephadm: override: [osd] osd scrub min interval = 60 2019-12-22T22:22:03.652 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2019-12-22T22:22:03.653 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2019-12-22T22:22:03.653 INFO:tasks.cephadm: override: [osd] osd scrub during recovery = False 2019-12-22T22:22:03.653 INFO:teuthology.orchestra.run.smithi071:> cat > /home/ubuntu/cephtest/seed.ceph.conf 2019-12-22T22:22:03.742 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7a4dd340-2509-11ea-8284-001a4aab830c ms inject delay max = 1 ms inject delay type = osd osd_pool_default_min_size = 2 ms bind msgr2 = False ms inject delay probability = 0.005 mon client directed command retry = 5 ms type = async ms inject socket failures = 2500 osd_pool_default_size = 3 ms inject internal delays = 0.002 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 120 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = True osd debug verify missing on start = True osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug journal = 20 osd max backfills = 6 debug osd = 25 osd map cache size = 1 osd backoff on peering = True osd scrub min interval = 60 debug filestore = 20 osd scrub during recovery = False [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug paxos = 20 mon min osdmap epochs = 50 debug ms = 1 mon osdmap full prune min = 15 mon osdmap full prune interval = 2 mon osdmap full prune txsize = 2 paxos service trim min = 10 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2019-12-22T22:22:03.742 INFO:tasks.cephadm:Bootstrapping... 2019-12-22T22:22:03.742 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 bootstrap --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --mon-id a --mgr-id y --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /home/ubuntu/cephtest/ceph.conf --output-keyring /home/ubuntu/cephtest/ceph.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --skip-ping-check --mon-addrv '[v1:172.21.15.71:6789]' && sudo chmod +r /home/ubuntu/cephtest/ceph.keyring 2019-12-22T22:22:03.987 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:root:Cluster fsid: 7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:22:03.988 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Pulling latest quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 container... 2019-12-22T22:22:31.439 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2019-12-22T22:22:40.735 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Creating initial keys... 2019-12-22T22:22:45.256 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Creating initial monmap... 2019-12-22T22:22:46.375 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Creating mon... 2019-12-22T22:22:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Waiting for mon to start... 2019-12-22T22:22:49.827 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2019-12-22T22:22:51.074 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2019-12-22T22:22:52.267 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Restarting the monitor... 2019-12-22T22:22:53.289 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Creating mgr... 2019-12-22T22:22:53.632 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Creating crash agent... 2019-12-22T22:22:53.640 INFO:teuthology.orchestra.run.smithi071.stderr:Created symlink from /etc/systemd/system/ceph-7a4dd340-2509-11ea-8284-001a4aab830c.target.wants/ceph-7a4dd340-2509-11ea-8284-001a4aab830c-crash.service to /etc/systemd/system/ceph-7a4dd340-2509-11ea-8284-001a4aab830c-crash.service. 2019-12-22T22:22:53.693 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Wrote keyring to /home/ubuntu/cephtest/ceph.keyring 2019-12-22T22:22:53.693 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Wrote config to /home/ubuntu/cephtest/ceph.conf 2019-12-22T22:22:53.694 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Waiting for mgr to start... 2019-12-22T22:22:55.558 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:mgr is still not available yet, waiting... 2019-12-22T22:22:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:mgr is still not available yet, waiting... 2019-12-22T22:22:59.999 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Enabling cephadm module... 2019-12-22T22:23:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Setting orchestrator backend to ssh... 2019-12-22T22:23:11.817 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Generating ssh key... 2019-12-22T22:23:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2019-12-22T22:23:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2019-12-22T22:23:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Adding host smithi071... 2019-12-22T22:23:27.138 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Enabling the dashboard module... 2019-12-22T22:23:28.508 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Waiting for the module to be available... 2019-12-22T22:23:29.679 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2019-12-22T22:23:33.628 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Creating initial admin user... 2019-12-22T22:23:35.359 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Fetching dashboard port number... 2019-12-22T22:23:36.693 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2019-12-22T22:23:36.694 INFO:teuthology.orchestra.run.smithi071.stderr: 2019-12-22T22:23:36.694 INFO:teuthology.orchestra.run.smithi071.stderr: URL: https://smithi071.front.sepia.ceph.com:8443/ 2019-12-22T22:23:36.694 INFO:teuthology.orchestra.run.smithi071.stderr: User: admin 2019-12-22T22:23:36.694 INFO:teuthology.orchestra.run.smithi071.stderr: Password: skyv4coixy 2019-12-22T22:23:36.694 INFO:teuthology.orchestra.run.smithi071.stderr: 2019-12-22T22:23:36.695 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:You can access the Ceph CLI with: 2019-12-22T22:23:36.695 INFO:teuthology.orchestra.run.smithi071.stderr: 2019-12-22T22:23:36.695 INFO:teuthology.orchestra.run.smithi071.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring 2019-12-22T22:23:36.695 INFO:teuthology.orchestra.run.smithi071.stderr: 2019-12-22T22:23:36.695 INFO:teuthology.orchestra.run.smithi071.stderr:INFO:cephadm:Bootstrap complete. 2019-12-22T22:23:36.759 INFO:teuthology.orchestra.run.smithi071:mon.a> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name mon.a 2019-12-22T22:23:36.766 INFO:teuthology.orchestra.run.smithi071:mgr.y> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name mgr.y 2019-12-22T22:23:36.809 INFO:tasks.cephadm:Fetching config... 2019-12-22T22:23:36.918 DEBUG:teuthology.orchestra.remote:smithi071:/home/ubuntu/cephtest/ceph.conf is 147B 2019-12-22T22:23:36.974 INFO:tasks.cephadm:Fetching client.admin keyring... 2019-12-22T22:23:37.021 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.745+0000 7f197ed8e6c0 0 set uid:gid to 167:167 (ceph:ceph) 2019-12-22T22:23:37.022 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.745+0000 7f197ed8e6c0 0 ceph version 15.0.0-8807-g99b509f (99b509ffd4dd354919b08b38ba83b998fbfdc107) octopus (dev), process ceph-mon, pid 1 2019-12-22T22:23:37.022 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.745+0000 7f197ed8e6c0 0 pidfile_write: ignore empty --pid-file 2019-12-22T22:23:37.022 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.750+0000 7f197ed8e6c0 0 load: jerasure load: lrc load: isa 2019-12-22T22:23:37.022 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.750+0000 7f197ed8e6c0 0 set rocksdb option compression = kNoCompression 2019-12-22T22:23:37.022 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.750+0000 7f197ed8e6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-22T22:23:37.022 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.750+0000 7f197ed8e6c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-22T22:23:37.023 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.750+0000 7f197ed8e6c0 0 set rocksdb option compression = kNoCompression 2019-12-22T22:23:37.023 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.750+0000 7f197ed8e6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-22T22:23:37.023 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.750+0000 7f197ed8e6c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-22T22:23:37.023 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 1 rocksdb: do_open column families: [default] 2019-12-22T22:23:37.023 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: RocksDB version: 6.1.2 2019-12-22T22:23:37.024 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.024 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2019-12-22T22:23:37.024 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Compile date Dec 22 2019 2019-12-22T22:23:37.024 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: DB SUMMARY 2019-12-22T22:23:37.028 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.029 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: CURRENT file: CURRENT 2019-12-22T22:23:37.029 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.029 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: IDENTITY file: IDENTITY 2019-12-22T22:23:37.029 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.029 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2019-12-22T22:23:37.029 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.030 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2019-12-22T22:23:37.030 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.030 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 72581 ; 2019-12-22T22:23:37.030 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.030 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.error_if_exists: 0 2019-12-22T22:23:37.030 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.create_if_missing: 0 2019-12-22T22:23:37.030 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.paranoid_checks: 1 2019-12-22T22:23:37.031 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.env: 0x560ecd76f260 2019-12-22T22:23:37.031 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.info_log: 0x560eceea0480 2019-12-22T22:23:37.031 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_file_opening_threads: 16 2019-12-22T22:23:37.031 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.statistics: (nil) 2019-12-22T22:23:37.031 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.use_fsync: 0 2019-12-22T22:23:37.031 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_log_file_size: 0 2019-12-22T22:23:37.032 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2019-12-22T22:23:37.032 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2019-12-22T22:23:37.032 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.keep_log_file_num: 1000 2019-12-22T22:23:37.032 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.recycle_log_file_num: 0 2019-12-22T22:23:37.032 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.allow_fallocate: 1 2019-12-22T22:23:37.032 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.allow_mmap_reads: 0 2019-12-22T22:23:37.032 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.allow_mmap_writes: 0 2019-12-22T22:23:37.033 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.use_direct_reads: 0 2019-12-22T22:23:37.033 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2019-12-22T22:23:37.033 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.create_missing_column_families: 0 2019-12-22T22:23:37.033 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.db_log_dir: 2019-12-22T22:23:37.034 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2019-12-22T22:23:37.034 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2019-12-22T22:23:37.034 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_subcompactions: 1 2019-12-22T22:23:37.034 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_background_flushes: -1 2019-12-22T22:23:37.034 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2019-12-22T22:23:37.034 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2019-12-22T22:23:37.034 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2019-12-22T22:23:37.035 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2019-12-22T22:23:37.035 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.advise_random_on_open: 1 2019-12-22T22:23:37.035 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.db_write_buffer_size: 0 2019-12-22T22:23:37.035 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.write_buffer_manager: 0x560ecfa48990 2019-12-22T22:23:37.035 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2019-12-22T22:23:37.036 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2019-12-22T22:23:37.036 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2019-12-22T22:23:37.036 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2019-12-22T22:23:37.036 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.rate_limiter: (nil) 2019-12-22T22:23:37.036 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2019-12-22T22:23:37.037 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.wal_recovery_mode: 2 2019-12-22T22:23:37.037 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.enable_thread_tracking: 0 2019-12-22T22:23:37.037 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.enable_pipelined_write: 0 2019-12-22T22:23:37.037 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2019-12-22T22:23:37.037 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2019-12-22T22:23:37.038 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2019-12-22T22:23:37.038 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2019-12-22T22:23:37.038 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.row_cache: None 2019-12-22T22:23:37.038 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.wal_filter: None 2019-12-22T22:23:37.038 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2019-12-22T22:23:37.039 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.allow_ingest_behind: 0 2019-12-22T22:23:37.039 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.preserve_deletes: 0 2019-12-22T22:23:37.039 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.two_write_queues: 0 2019-12-22T22:23:37.039 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.manual_wal_flush: 0 2019-12-22T22:23:37.040 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.atomic_flush: 0 2019-12-22T22:23:37.040 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2019-12-22T22:23:37.040 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_background_jobs: 2 2019-12-22T22:23:37.040 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_background_compactions: -1 2019-12-22T22:23:37.040 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2019-12-22T22:23:37.041 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2019-12-22T22:23:37.041 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2019-12-22T22:23:37.041 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_total_wal_size: 0 2019-12-22T22:23:37.041 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2019-12-22T22:23:37.042 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2019-12-22T22:23:37.042 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2019-12-22T22:23:37.042 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2019-12-22T22:23:37.042 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_open_files: -1 2019-12-22T22:23:37.042 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.bytes_per_sync: 0 2019-12-22T22:23:37.043 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2019-12-22T22:23:37.043 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_readahead_size: 0 2019-12-22T22:23:37.043 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Compression algorithms supported: 2019-12-22T22:23:37.043 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2019-12-22T22:23:37.044 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: kZSTD supported: 0 2019-12-22T22:23:37.044 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: kXpressCompression supported: 0 2019-12-22T22:23:37.044 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: kLZ4HCCompression supported: 1 2019-12-22T22:23:37.044 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: kLZ4Compression supported: 1 2019-12-22T22:23:37.045 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: kBZip2Compression supported: 0 2019-12-22T22:23:37.045 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: kZlibCompression supported: 1 2019-12-22T22:23:37.045 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: kSnappyCompression supported: 1 2019-12-22T22:23:37.045 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2019-12-22T22:23:37.045 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2019-12-22T22:23:37.046 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.046 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2019-12-22T22:23:37.046 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.046 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2019-12-22T22:23:37.047 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.merge_operator: 2019-12-22T22:23:37.047 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_filter: None 2019-12-22T22:23:37.047 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_filter_factory: None 2019-12-22T22:23:37.047 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2019-12-22T22:23:37.047 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2019-12-22T22:23:37.048 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560ecedbc0c8) 2019-12-22T22:23:37.048 INFO:ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks: 1 2019-12-22T22:23:37.049 INFO:ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 1 2019-12-22T22:23:37.049 INFO:ceph.mon.a.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2019-12-22T22:23:37.050 INFO:ceph.mon.a.smithi071.stdout: pin_top_level_index_and_filter: 1 2019-12-22T22:23:37.050 INFO:ceph.mon.a.smithi071.stdout: index_type: 0 2019-12-22T22:23:37.050 INFO:ceph.mon.a.smithi071.stdout: data_block_index_type: 0 2019-12-22T22:23:37.050 INFO:ceph.mon.a.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2019-12-22T22:23:37.050 INFO:ceph.mon.a.smithi071.stdout: hash_index_allow_collision: 1 2019-12-22T22:23:37.051 INFO:ceph.mon.a.smithi071.stdout: checksum: 1 2019-12-22T22:23:37.051 INFO:ceph.mon.a.smithi071.stdout: no_block_cache: 0 2019-12-22T22:23:37.051 INFO:ceph.mon.a.smithi071.stdout: block_cache: 0x560ecedf6210 2019-12-22T22:23:37.051 INFO:ceph.mon.a.smithi071.stdout: block_cache_name: BinnedLRUCache 2019-12-22T22:23:37.052 INFO:ceph.mon.a.smithi071.stdout: block_cache_options: 2019-12-22T22:23:37.052 INFO:ceph.mon.a.smithi071.stdout: capacity : 536870912 2019-12-22T22:23:37.052 INFO:ceph.mon.a.smithi071.stdout: num_shard_bits : 4 2019-12-22T22:23:37.052 INFO:ceph.mon.a.smithi071.stdout: strict_capacity_limit : 0 2019-12-22T22:23:37.053 INFO:ceph.mon.a.smithi071.stdout: high_pri_pool_ratio: 0.000 2019-12-22T22:23:37.053 INFO:ceph.mon.a.smithi071.stdout: block_cache_compressed: (nil) 2019-12-22T22:23:37.053 INFO:ceph.mon.a.smithi071.stdout: persistent_cache: (nil) 2019-12-22T22:23:37.053 INFO:ceph.mon.a.smithi071.stdout: block_size: 4096 2019-12-22T22:23:37.053 INFO:ceph.mon.a.smithi071.stdout: block_size_deviation: 10 2019-12-22T22:23:37.054 INFO:ceph.mon.a.smithi071.stdout: block_restart_interval: 16 2019-12-22T22:23:37.054 INFO:ceph.mon.a.smithi071.stdout: index_block_restart_interval: 1 2019-12-22T22:23:37.054 INFO:ceph.mon.a.smithi071.stdout: metadata_block_size: 4096 2019-12-22T22:23:37.054 INFO:ceph.mon.a.smithi071.stdout: partition_filters: 0 2019-12-22T22:23:37.055 INFO:ceph.mon.a.smithi071.stdout: use_delta_encoding: 1 2019-12-22T22:23:37.055 INFO:ceph.mon.a.smithi071.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2019-12-22T22:23:37.055 INFO:ceph.mon.a.smithi071.stdout: whole_key_filtering: 1 2019-12-22T22:23:37.055 INFO:ceph.mon.a.smithi071.stdout: verify_compression: 0 2019-12-22T22:23:37.056 INFO:ceph.mon.a.smithi071.stdout: read_amp_bytes_per_bit: 0 2019-12-22T22:23:37.056 INFO:ceph.mon.a.smithi071.stdout: format_version: 2 2019-12-22T22:23:37.056 INFO:ceph.mon.a.smithi071.stdout: enable_index_compression: 1 2019-12-22T22:23:37.056 INFO:ceph.mon.a.smithi071.stdout: block_align: 0 2019-12-22T22:23:37.056 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.057 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.write_buffer_size: 33554432 2019-12-22T22:23:37.057 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_write_buffer_number: 2 2019-12-22T22:23:37.057 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compression: NoCompression 2019-12-22T22:23:37.057 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.bottommost_compression: Disabled 2019-12-22T22:23:37.058 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.prefix_extractor: nullptr 2019-12-22T22:23:37.058 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2019-12-22T22:23:37.058 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.num_levels: 7 2019-12-22T22:23:37.058 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2019-12-22T22:23:37.059 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2019-12-22T22:23:37.059 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2019-12-22T22:23:37.059 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2019-12-22T22:23:37.059 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2019-12-22T22:23:37.060 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2019-12-22T22:23:37.060 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2019-12-22T22:23:37.060 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2019-12-22T22:23:37.060 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2019-12-22T22:23:37.061 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compression_opts.level: 32767 2019-12-22T22:23:37.061 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compression_opts.strategy: 0 2019-12-22T22:23:37.063 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2019-12-22T22:23:37.063 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2019-12-22T22:23:37.064 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.compression_opts.enabled: false 2019-12-22T22:23:37.064 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.751+0000 7f197ed8e6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2019-12-22T22:23:37.064 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2019-12-22T22:23:37.064 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2019-12-22T22:23:37.065 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.target_file_size_base: 67108864 2019-12-22T22:23:37.065 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2019-12-22T22:23:37.065 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2019-12-22T22:23:37.065 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2019-12-22T22:23:37.066 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2019-12-22T22:23:37.066 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2019-12-22T22:23:37.066 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2019-12-22T22:23:37.066 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2019-12-22T22:23:37.067 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2019-12-22T22:23:37.067 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2019-12-22T22:23:37.067 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2019-12-22T22:23:37.067 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2019-12-22T22:23:37.067 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2019-12-22T22:23:37.068 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2019-12-22T22:23:37.068 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.arena_block_size: 4194304 2019-12-22T22:23:37.068 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2019-12-22T22:23:37.069 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2019-12-22T22:23:37.069 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2019-12-22T22:23:37.069 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.disable_auto_compactions: 0 2019-12-22T22:23:37.069 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2019-12-22T22:23:37.070 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2019-12-22T22:23:37.070 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2019-12-22T22:23:37.070 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2019-12-22T22:23:37.070 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2019-12-22T22:23:37.071 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2019-12-22T22:23:37.071 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2019-12-22T22:23:37.071 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2019-12-22T22:23:37.071 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2019-12-22T22:23:37.072 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2019-12-22T22:23:37.072 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.table_properties_collectors: 2019-12-22T22:23:37.072 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.inplace_update_support: 0 2019-12-22T22:23:37.072 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2019-12-22T22:23:37.072 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2019-12-22T22:23:37.073 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2019-12-22T22:23:37.073 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2019-12-22T22:23:37.073 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.bloom_locality: 0 2019-12-22T22:23:37.073 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.max_successive_merges: 0 2019-12-22T22:23:37.073 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2019-12-22T22:23:37.074 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.paranoid_file_checks: 0 2019-12-22T22:23:37.074 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.force_consistency_checks: 0 2019-12-22T22:23:37.074 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.report_bg_io_stats: 0 2019-12-22T22:23:37.074 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.752+0000 7f197ed8e6c0 4 rocksdb: Options.ttl: 0 2019-12-22T22:23:37.074 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.753+0000 7f197ed8e6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2019-12-22T22:23:37.074 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.075 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.753+0000 7f197ed8e6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2019-12-22T22:23:37.075 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.075 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.753+0000 7f197ed8e6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053373754351, "job": 1, "event": "recovery_started", "log_files": [6]} 2019-12-22T22:23:37.075 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.753+0000 7f197ed8e6c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2019-12-22T22:23:37.075 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.755+0000 7f197ed8e6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053373756673, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 68493, "table_properties": {"data_size": 66814, "index_size": 284, "filter_size": 581, "raw_key_size": 10940, "raw_average_key_size": 49, "raw_value_size": 60867, "raw_average_value_size": 275, "num_data_blocks": 10, "num_entries": 221, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-22T22:23:37.076 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.755+0000 7f197ed8e6c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2019-12-22T22:23:37.076 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.076 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.756+0000 7f197ed8e6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053373757385, "job": 1, "event": "recovery_finished"} 2019-12-22T22:23:37.077 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.758+0000 7f197ed8e6c0 4 rocksdb: DB pointer 0x560ecfa2b200 2019-12-22T22:23:37.077 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.758+0000 7f1965ec1700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2019-12-22T22:23:37.078 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.759+0000 7f1965ec1700 4 rocksdb: [db/db_impl.cc:778] 2019-12-22T22:23:37.078 INFO:ceph.mon.a.smithi071.stdout:** DB Stats ** 2019-12-22T22:23:37.078 INFO:ceph.mon.a.smithi071.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-22T22:23:37.079 INFO:ceph.mon.a.smithi071.stdout:Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2019-12-22T22:23:37.079 INFO:ceph.mon.a.smithi071.stdout:Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2019-12-22T22:23:37.079 INFO:ceph.mon.a.smithi071.stdout:Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-22T22:23:37.079 INFO:ceph.mon.a.smithi071.stdout:Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2019-12-22T22:23:37.080 INFO:ceph.mon.a.smithi071.stdout:Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2019-12-22T22:23:37.080 INFO:ceph.mon.a.smithi071.stdout:Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-22T22:23:37.080 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.080 INFO:ceph.mon.a.smithi071.stdout:** Compaction Stats [default] ** 2019-12-22T22:23:37.080 INFO:ceph.mon.a.smithi071.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:23:37.081 INFO:ceph.mon.a.smithi071.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:23:37.081 INFO:ceph.mon.a.smithi071.stdout: L0 2/0 68.60 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 47.1 0.00 0.00 1 0.001 0 0 2019-12-22T22:23:37.081 INFO:ceph.mon.a.smithi071.stdout: Sum 2/0 68.60 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 47.1 0.00 0.00 1 0.001 0 0 2019-12-22T22:23:37.081 INFO:ceph.mon.a.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 47.1 0.00 0.00 1 0.001 0 0 2019-12-22T22:23:37.081 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.081 INFO:ceph.mon.a.smithi071.stdout:** Compaction Stats [default] ** 2019-12-22T22:23:37.082 INFO:ceph.mon.a.smithi071.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:23:37.082 INFO:ceph.mon.a.smithi071.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:23:37.082 INFO:ceph.mon.a.smithi071.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 47.1 0.00 0.00 1 0.001 0 0 2019-12-22T22:23:37.082 INFO:ceph.mon.a.smithi071.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-22T22:23:37.082 INFO:ceph.mon.a.smithi071.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-22T22:23:37.083 INFO:ceph.mon.a.smithi071.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-22T22:23:37.083 INFO:ceph.mon.a.smithi071.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-22T22:23:37.083 INFO:ceph.mon.a.smithi071.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-22T22:23:37.083 INFO:ceph.mon.a.smithi071.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-22T22:23:37.084 INFO:ceph.mon.a.smithi071.stdout:Cumulative compaction: 0.00 GB write, 9.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:23:37.084 INFO:ceph.mon.a.smithi071.stdout:Interval compaction: 0.00 GB write, 9.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:23:37.084 INFO:ceph.mon.a.smithi071.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-22T22:23:37.084 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.085 INFO:ceph.mon.a.smithi071.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-22T22:23:37.085 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.085 INFO:ceph.mon.a.smithi071.stdout:** Compaction Stats [default] ** 2019-12-22T22:23:37.085 INFO:ceph.mon.a.smithi071.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:23:37.086 INFO:ceph.mon.a.smithi071.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:23:37.086 INFO:ceph.mon.a.smithi071.stdout: L0 2/0 68.60 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 47.1 0.00 0.00 1 0.001 0 0 2019-12-22T22:23:37.086 INFO:ceph.mon.a.smithi071.stdout: Sum 2/0 68.60 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 47.1 0.00 0.00 1 0.001 0 0 2019-12-22T22:23:37.086 INFO:ceph.mon.a.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2019-12-22T22:23:37.086 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.087 INFO:ceph.mon.a.smithi071.stdout:** Compaction Stats [default] ** 2019-12-22T22:23:37.087 INFO:ceph.mon.a.smithi071.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:23:37.087 INFO:ceph.mon.a.smithi071.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:23:37.087 INFO:ceph.mon.a.smithi071.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 47.1 0.00 0.00 1 0.001 0 0 2019-12-22T22:23:37.088 INFO:ceph.mon.a.smithi071.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-22T22:23:37.088 INFO:ceph.mon.a.smithi071.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-22T22:23:37.088 INFO:ceph.mon.a.smithi071.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-22T22:23:37.088 INFO:ceph.mon.a.smithi071.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-22T22:23:37.088 INFO:ceph.mon.a.smithi071.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-22T22:23:37.089 INFO:ceph.mon.a.smithi071.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-22T22:23:37.089 INFO:ceph.mon.a.smithi071.stdout:Cumulative compaction: 0.00 GB write, 9.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:23:37.089 INFO:ceph.mon.a.smithi071.stdout:Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:23:37.089 INFO:ceph.mon.a.smithi071.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-22T22:23:37.090 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.090 INFO:ceph.mon.a.smithi071.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-22T22:23:37.090 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.090 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.760+0000 7f197ed8e6c0 0 starting mon.a rank 0 at public addrs v1:172.21.15.71:6789/0 at bind addrs v1:172.21.15.71:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid 7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:23:37.090 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.762+0000 7f197ed8e6c0 1 mon.a@-1(???) e1 preinit fsid 7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:23:37.090 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.763+0000 7f197ed8e6c0 0 mon.a@-1(???).mds e1 new map 2019-12-22T22:23:37.091 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.763+0000 7f197ed8e6c0 0 mon.a@-1(???).mds e1 print_map 2019-12-22T22:23:37.092 INFO:ceph.mon.a.smithi071.stdout:e1 2019-12-22T22:23:37.092 INFO:ceph.mon.a.smithi071.stdout:enable_multiple, ever_enabled_multiple: 0,0 2019-12-22T22:23:37.092 INFO:ceph.mon.a.smithi071.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2019-12-22T22:23:37.092 INFO:ceph.mon.a.smithi071.stdout:legacy client fscid: -1 2019-12-22T22:23:37.092 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.093 INFO:ceph.mon.a.smithi071.stdout:No filesystems configured 2019-12-22T22:23:37.093 INFO:ceph.mon.a.smithi071.stdout: 2019-12-22T22:23:37.093 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.763+0000 7f197ed8e6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2019-12-22T22:23:37.093 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.763+0000 7f197ed8e6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2019-12-22T22:23:37.093 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.763+0000 7f197ed8e6c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2019-12-22T22:23:37.093 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.763+0000 7f197ed8e6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2019-12-22T22:23:37.093 INFO:ceph.mon.a.smithi071.stdout:2019-12-22T22:22:53.763+0000 7f197ed8e6c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2019-12-22T22:23:37.095 INFO:ceph.mgr.y.smithi071.stdout:ignoring --setuser ceph since I am not root 2019-12-22T22:23:37.095 INFO:ceph.mgr.y.smithi071.stdout:ignoring --setgroup ceph since I am not root 2019-12-22T22:23:37.096 INFO:ceph.mgr.y.smithi071.stdout:Generating public/private rsa key pair. 2019-12-22T22:23:37.096 INFO:ceph.mgr.y.smithi071.stdout:Your identification has been saved in /tmp/tmpn45omxqe/key. 2019-12-22T22:23:37.096 INFO:ceph.mgr.y.smithi071.stdout:Your public key has been saved in /tmp/tmpn45omxqe/key.pub. 2019-12-22T22:23:37.096 INFO:ceph.mgr.y.smithi071.stdout:The key fingerprint is: 2019-12-22T22:23:37.096 INFO:ceph.mgr.y.smithi071.stdout:SHA256:j0yCzmE8d9RU6xyrNYz4A7QDhAWZnqSv4IbAbU6MXRg ceph-7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:23:37.096 INFO:ceph.mgr.y.smithi071.stdout:The key's randomart image is: 2019-12-22T22:23:37.097 INFO:ceph.mgr.y.smithi071.stdout:+---[RSA 2048]----+ 2019-12-22T22:23:37.097 INFO:ceph.mgr.y.smithi071.stdout:| .*o ... | 2019-12-22T22:23:37.097 INFO:ceph.mgr.y.smithi071.stdout:| E=. o . | 2019-12-22T22:23:37.097 INFO:ceph.mgr.y.smithi071.stdout:| +o.. o . o | 2019-12-22T22:23:37.097 INFO:ceph.mgr.y.smithi071.stdout:| .ooo + o = o | 2019-12-22T22:23:37.097 INFO:ceph.mgr.y.smithi071.stdout:|. =.B o S . B | 2019-12-22T22:23:37.098 INFO:ceph.mgr.y.smithi071.stdout:|oo X.+ = * o . | 2019-12-22T22:23:37.098 INFO:ceph.mgr.y.smithi071.stdout:|+.+.o o = | 2019-12-22T22:23:37.098 INFO:ceph.mgr.y.smithi071.stdout:|.o.. . | 2019-12-22T22:23:37.098 INFO:ceph.mgr.y.smithi071.stdout:|. | 2019-12-22T22:23:37.099 INFO:ceph.mgr.y.smithi071.stdout:+----[SHA256]-----+ 2019-12-22T22:23:37.099 INFO:ceph.mgr.y.smithi071.stdout:ignoring --setuser ceph since I am not root 2019-12-22T22:23:37.099 INFO:ceph.mgr.y.smithi071.stdout:ignoring --setgroup ceph since I am not root 2019-12-22T22:23:37.101 DEBUG:teuthology.orchestra.remote:smithi071:/home/ubuntu/cephtest/ceph.keyring is 63B 2019-12-22T22:23:37.193 INFO:tasks.cephadm:Fetching mon keyring... 2019-12-22T22:23:37.194 INFO:teuthology.orchestra.run.smithi071:> mktemp 2019-12-22T22:23:37.265 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.bhEiEaF4gk 2019-12-22T22:23:37.268 INFO:teuthology.orchestra.run.smithi071:> sudo cp /var/lib/ceph/7a4dd340-2509-11ea-8284-001a4aab830c/mon.a/keyring /tmp/tmp.bhEiEaF4gk 2019-12-22T22:23:37.427 INFO:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.bhEiEaF4gk 2019-12-22T22:23:37.624 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.bhEiEaF4gk is 77B 2019-12-22T22:23:37.704 INFO:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.bhEiEaF4gk 2019-12-22T22:23:37.777 INFO:tasks.cephadm:Fetching pub ssh key... 2019-12-22T22:23:37.853 DEBUG:teuthology.orchestra.remote:smithi071:/home/ubuntu/cephtest/ceph.pub is 423B 2019-12-22T22:23:37.938 INFO:tasks.cephadm:Installing pub ssh key for root users... 2019-12-22T22:23:37.939 INFO:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGvJyv6S5YB8KEVg/zadOkSSSYI58uiTP/LPORI8s3XeD5Nz3z+oPvwZy1kozPvOcPpAZV16hGJ/h9JupyuDnOgLavAlrJ0tcUJ/kVK84/m1qN7s1xxdZhoYnIB86zqY/d0EnxaQ7eAYA9pBIqFUoTVUhXKItNt0oEPj/mwspgakUL0ql6jWP3mjvmpJFFJgeoliTIVjWwQ5FsNS4U8fl7MTWLK71kxTMnFHN6TrQ1css2w4SF18blZ6LQzKyNTUTUz91gtI9sz0+5Gvh8q9RdKpSqPJpNW17MUdREEM2MX++4sxOwGbUdgILbbPpMjxGzdqxNyWu6XfCWLWthAm9j ceph-7a4dd340-2509-11ea-8284-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2019-12-22T22:23:38.069 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGvJyv6S5YB8KEVg/zadOkSSSYI58uiTP/LPORI8s3XeD5Nz3z+oPvwZy1kozPvOcPpAZV16hGJ/h9JupyuDnOgLavAlrJ0tcUJ/kVK84/m1qN7s1xxdZhoYnIB86zqY/d0EnxaQ7eAYA9pBIqFUoTVUhXKItNt0oEPj/mwspgakUL0ql6jWP3mjvmpJFFJgeoliTIVjWwQ5FsNS4U8fl7MTWLK71kxTMnFHN6TrQ1css2w4SF18blZ6LQzKyNTUTUz91gtI9sz0+5Gvh8q9RdKpSqPJpNW17MUdREEM2MX++4sxOwGbUdgILbbPpMjxGzdqxNyWu6XfCWLWthAm9j ceph-7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:23:38.092 INFO:teuthology.orchestra.run.smithi168:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGvJyv6S5YB8KEVg/zadOkSSSYI58uiTP/LPORI8s3XeD5Nz3z+oPvwZy1kozPvOcPpAZV16hGJ/h9JupyuDnOgLavAlrJ0tcUJ/kVK84/m1qN7s1xxdZhoYnIB86zqY/d0EnxaQ7eAYA9pBIqFUoTVUhXKItNt0oEPj/mwspgakUL0ql6jWP3mjvmpJFFJgeoliTIVjWwQ5FsNS4U8fl7MTWLK71kxTMnFHN6TrQ1css2w4SF18blZ6LQzKyNTUTUz91gtI9sz0+5Gvh8q9RdKpSqPJpNW17MUdREEM2MX++4sxOwGbUdgILbbPpMjxGzdqxNyWu6XfCWLWthAm9j ceph-7a4dd340-2509-11ea-8284-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2019-12-22T22:23:38.235 INFO:teuthology.orchestra.run.smithi168.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGvJyv6S5YB8KEVg/zadOkSSSYI58uiTP/LPORI8s3XeD5Nz3z+oPvwZy1kozPvOcPpAZV16hGJ/h9JupyuDnOgLavAlrJ0tcUJ/kVK84/m1qN7s1xxdZhoYnIB86zqY/d0EnxaQ7eAYA9pBIqFUoTVUhXKItNt0oEPj/mwspgakUL0ql6jWP3mjvmpJFFJgeoliTIVjWwQ5FsNS4U8fl7MTWLK71kxTMnFHN6TrQ1css2w4SF18blZ6LQzKyNTUTUz91gtI9sz0+5Gvh8q9RdKpSqPJpNW17MUdREEM2MX++4sxOwGbUdgILbbPpMjxGzdqxNyWu6XfCWLWthAm9j ceph-7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:23:38.266 INFO:teuthology.orchestra.run.smithi187:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGvJyv6S5YB8KEVg/zadOkSSSYI58uiTP/LPORI8s3XeD5Nz3z+oPvwZy1kozPvOcPpAZV16hGJ/h9JupyuDnOgLavAlrJ0tcUJ/kVK84/m1qN7s1xxdZhoYnIB86zqY/d0EnxaQ7eAYA9pBIqFUoTVUhXKItNt0oEPj/mwspgakUL0ql6jWP3mjvmpJFFJgeoliTIVjWwQ5FsNS4U8fl7MTWLK71kxTMnFHN6TrQ1css2w4SF18blZ6LQzKyNTUTUz91gtI9sz0+5Gvh8q9RdKpSqPJpNW17MUdREEM2MX++4sxOwGbUdgILbbPpMjxGzdqxNyWu6XfCWLWthAm9j ceph-7a4dd340-2509-11ea-8284-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2019-12-22T22:23:38.410 INFO:teuthology.orchestra.run.smithi187.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGvJyv6S5YB8KEVg/zadOkSSSYI58uiTP/LPORI8s3XeD5Nz3z+oPvwZy1kozPvOcPpAZV16hGJ/h9JupyuDnOgLavAlrJ0tcUJ/kVK84/m1qN7s1xxdZhoYnIB86zqY/d0EnxaQ7eAYA9pBIqFUoTVUhXKItNt0oEPj/mwspgakUL0ql6jWP3mjvmpJFFJgeoliTIVjWwQ5FsNS4U8fl7MTWLK71kxTMnFHN6TrQ1css2w4SF18blZ6LQzKyNTUTUz91gtI9sz0+5Gvh8q9RdKpSqPJpNW17MUdREEM2MX++4sxOwGbUdgILbbPpMjxGzdqxNyWu6XfCWLWthAm9j ceph-7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:23:38.442 INFO:tasks.cephadm:Writing conf and keyring to smithi168 2019-12-22T22:23:38.442 INFO:teuthology.orchestra.run.smithi168:> cat > /home/ubuntu/cephtest/ceph.conf 2019-12-22T22:23:38.530 INFO:teuthology.orchestra.run.smithi168:> cat > /home/ubuntu/cephtest/ceph.keyring 2019-12-22T22:23:38.616 INFO:tasks.cephadm:Adding host smithi168 to orchestrator... 2019-12-22T22:23:38.616 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator host add smithi168 2019-12-22T22:24:18.288 INFO:teuthology.orchestra.run.smithi168.stdout:Added host 'smithi168' 2019-12-22T22:24:19.011 INFO:tasks.cephadm:Writing conf and keyring to smithi187 2019-12-22T22:24:19.011 INFO:teuthology.orchestra.run.smithi187:> cat > /home/ubuntu/cephtest/ceph.conf 2019-12-22T22:24:19.101 INFO:teuthology.orchestra.run.smithi187:> cat > /home/ubuntu/cephtest/ceph.keyring 2019-12-22T22:24:19.176 INFO:tasks.cephadm:Adding host smithi187 to orchestrator... 2019-12-22T22:24:19.176 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator host add smithi187 2019-12-22T22:24:58.006 INFO:teuthology.orchestra.run.smithi187.stdout:Added host 'smithi187' 2019-12-22T22:24:58.716 INFO:tasks.cephadm:Adding mon.c on smithi168 2019-12-22T22:24:58.717 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator mon update 2 'smithi168:[v1:172.21.15.168:6789]=c' 2019-12-22T22:25:01.108 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:25:02.108 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:25:03.109 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:25:04.109 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:25:07.956 INFO:teuthology.orchestra.run.smithi168.stdout:["(Re)deployed mon.c on host 'smithi168'"] 2019-12-22T22:25:08.552 INFO:teuthology.orchestra.run.smithi168:mon.c> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name mon.c 2019-12-22T22:25:08.559 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2019-12-22T22:25:08.559 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph mon dump -f json 2019-12-22T22:25:08.829 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.917+0000 7f9b938206c0 0 set uid:gid to 167:167 (ceph:ceph) 2019-12-22T22:25:08.829 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.917+0000 7f9b938206c0 0 ceph version 15.0.0-8807-g99b509f (99b509ffd4dd354919b08b38ba83b998fbfdc107) octopus (dev), process ceph-mon, pid 1 2019-12-22T22:25:08.829 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.917+0000 7f9b938206c0 0 pidfile_write: ignore empty --pid-file 2019-12-22T22:25:08.829 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.923+0000 7f9b938206c0 0 load: jerasure load: lrc load: isa 2019-12-22T22:25:08.829 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.923+0000 7f9b938206c0 0 set rocksdb option compression = kNoCompression 2019-12-22T22:25:08.830 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.923+0000 7f9b938206c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-22T22:25:08.830 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.923+0000 7f9b938206c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-22T22:25:08.830 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.923+0000 7f9b938206c0 0 set rocksdb option compression = kNoCompression 2019-12-22T22:25:08.830 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.923+0000 7f9b938206c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-22T22:25:08.830 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.923+0000 7f9b938206c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-22T22:25:08.830 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 1 rocksdb: do_open column families: [default] 2019-12-22T22:25:08.830 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: RocksDB version: 6.1.2 2019-12-22T22:25:08.831 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.831 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2019-12-22T22:25:08.831 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Compile date Dec 22 2019 2019-12-22T22:25:08.831 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: DB SUMMARY 2019-12-22T22:25:08.831 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.831 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: CURRENT file: CURRENT 2019-12-22T22:25:08.831 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.832 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: IDENTITY file: IDENTITY 2019-12-22T22:25:08.832 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.832 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2019-12-22T22:25:08.832 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.832 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2019-12-22T22:25:08.832 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.832 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 454 ; 2019-12-22T22:25:08.833 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.833 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.error_if_exists: 0 2019-12-22T22:25:08.833 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.create_if_missing: 0 2019-12-22T22:25:08.833 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.paranoid_checks: 1 2019-12-22T22:25:08.833 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.env: 0x556db5dcf260 2019-12-22T22:25:08.833 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.info_log: 0x556db7a18460 2019-12-22T22:25:08.833 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_file_opening_threads: 16 2019-12-22T22:25:08.834 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.statistics: (nil) 2019-12-22T22:25:08.834 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.use_fsync: 0 2019-12-22T22:25:08.834 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_log_file_size: 0 2019-12-22T22:25:08.834 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2019-12-22T22:25:08.834 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.log_file_time_to_roll: 0 2019-12-22T22:25:08.834 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.keep_log_file_num: 1000 2019-12-22T22:25:08.835 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.recycle_log_file_num: 0 2019-12-22T22:25:08.835 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.allow_fallocate: 1 2019-12-22T22:25:08.835 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.allow_mmap_reads: 0 2019-12-22T22:25:08.835 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.allow_mmap_writes: 0 2019-12-22T22:25:08.835 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.use_direct_reads: 0 2019-12-22T22:25:08.835 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2019-12-22T22:25:08.835 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.create_missing_column_families: 0 2019-12-22T22:25:08.835 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.db_log_dir: 2019-12-22T22:25:08.836 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2019-12-22T22:25:08.836 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.table_cache_numshardbits: 6 2019-12-22T22:25:08.836 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_subcompactions: 1 2019-12-22T22:25:08.836 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_background_flushes: -1 2019-12-22T22:25:08.836 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2019-12-22T22:25:08.836 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2019-12-22T22:25:08.836 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2019-12-22T22:25:08.837 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2019-12-22T22:25:08.837 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.advise_random_on_open: 1 2019-12-22T22:25:08.837 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.db_write_buffer_size: 0 2019-12-22T22:25:08.837 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.write_buffer_manager: 0x556db85c09f0 2019-12-22T22:25:08.837 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2019-12-22T22:25:08.837 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2019-12-22T22:25:08.837 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2019-12-22T22:25:08.838 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.use_adaptive_mutex: 0 2019-12-22T22:25:08.838 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.rate_limiter: (nil) 2019-12-22T22:25:08.838 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2019-12-22T22:25:08.838 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.wal_recovery_mode: 2 2019-12-22T22:25:08.838 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.enable_thread_tracking: 0 2019-12-22T22:25:08.838 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.enable_pipelined_write: 0 2019-12-22T22:25:08.838 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2019-12-22T22:25:08.839 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2019-12-22T22:25:08.839 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2019-12-22T22:25:08.839 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2019-12-22T22:25:08.839 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.row_cache: None 2019-12-22T22:25:08.839 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.wal_filter: None 2019-12-22T22:25:08.839 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2019-12-22T22:25:08.839 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.allow_ingest_behind: 0 2019-12-22T22:25:08.840 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.preserve_deletes: 0 2019-12-22T22:25:08.840 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.two_write_queues: 0 2019-12-22T22:25:08.840 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.manual_wal_flush: 0 2019-12-22T22:25:08.840 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.atomic_flush: 0 2019-12-22T22:25:08.840 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2019-12-22T22:25:08.840 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_background_jobs: 2 2019-12-22T22:25:08.840 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_background_compactions: -1 2019-12-22T22:25:08.841 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2019-12-22T22:25:08.841 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2019-12-22T22:25:08.841 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.delayed_write_rate : 16777216 2019-12-22T22:25:08.841 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_total_wal_size: 0 2019-12-22T22:25:08.841 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2019-12-22T22:25:08.841 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.stats_dump_period_sec: 600 2019-12-22T22:25:08.841 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.stats_persist_period_sec: 600 2019-12-22T22:25:08.842 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2019-12-22T22:25:08.842 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_open_files: -1 2019-12-22T22:25:08.842 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.bytes_per_sync: 0 2019-12-22T22:25:08.842 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2019-12-22T22:25:08.842 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compaction_readahead_size: 0 2019-12-22T22:25:08.842 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Compression algorithms supported: 2019-12-22T22:25:08.842 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2019-12-22T22:25:08.843 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: kZSTD supported: 0 2019-12-22T22:25:08.843 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: kXpressCompression supported: 0 2019-12-22T22:25:08.843 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: kLZ4HCCompression supported: 1 2019-12-22T22:25:08.843 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: kLZ4Compression supported: 1 2019-12-22T22:25:08.843 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: kBZip2Compression supported: 0 2019-12-22T22:25:08.843 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: kZlibCompression supported: 1 2019-12-22T22:25:08.843 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: kSnappyCompression supported: 1 2019-12-22T22:25:08.844 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2019-12-22T22:25:08.844 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2019-12-22T22:25:08.844 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.844 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2019-12-22T22:25:08.844 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.844 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2019-12-22T22:25:08.844 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.merge_operator: 2019-12-22T22:25:08.845 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compaction_filter: None 2019-12-22T22:25:08.845 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compaction_filter_factory: None 2019-12-22T22:25:08.845 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2019-12-22T22:25:08.845 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.table_factory: BlockBasedTable 2019-12-22T22:25:08.845 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556db79340c8) 2019-12-22T22:25:08.846 INFO:ceph.mon.c.smithi168.stdout: cache_index_and_filter_blocks: 1 2019-12-22T22:25:08.846 INFO:ceph.mon.c.smithi168.stdout: cache_index_and_filter_blocks_with_high_priority: 1 2019-12-22T22:25:08.846 INFO:ceph.mon.c.smithi168.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2019-12-22T22:25:08.846 INFO:ceph.mon.c.smithi168.stdout: pin_top_level_index_and_filter: 1 2019-12-22T22:25:08.846 INFO:ceph.mon.c.smithi168.stdout: index_type: 0 2019-12-22T22:25:08.846 INFO:ceph.mon.c.smithi168.stdout: data_block_index_type: 0 2019-12-22T22:25:08.846 INFO:ceph.mon.c.smithi168.stdout: data_block_hash_table_util_ratio: 0.750000 2019-12-22T22:25:08.846 INFO:ceph.mon.c.smithi168.stdout: hash_index_allow_collision: 1 2019-12-22T22:25:08.847 INFO:ceph.mon.c.smithi168.stdout: checksum: 1 2019-12-22T22:25:08.847 INFO:ceph.mon.c.smithi168.stdout: no_block_cache: 0 2019-12-22T22:25:08.847 INFO:ceph.mon.c.smithi168.stdout: block_cache: 0x556db796e210 2019-12-22T22:25:08.847 INFO:ceph.mon.c.smithi168.stdout: block_cache_name: BinnedLRUCache 2019-12-22T22:25:08.847 INFO:ceph.mon.c.smithi168.stdout: block_cache_options: 2019-12-22T22:25:08.847 INFO:ceph.mon.c.smithi168.stdout: capacity : 536870912 2019-12-22T22:25:08.847 INFO:ceph.mon.c.smithi168.stdout: num_shard_bits : 4 2019-12-22T22:25:08.848 INFO:ceph.mon.c.smithi168.stdout: strict_capacity_limit : 0 2019-12-22T22:25:08.848 INFO:ceph.mon.c.smithi168.stdout: high_pri_pool_ratio: 0.000 2019-12-22T22:25:08.848 INFO:ceph.mon.c.smithi168.stdout: block_cache_compressed: (nil) 2019-12-22T22:25:08.848 INFO:ceph.mon.c.smithi168.stdout: persistent_cache: (nil) 2019-12-22T22:25:08.848 INFO:ceph.mon.c.smithi168.stdout: block_size: 4096 2019-12-22T22:25:08.848 INFO:ceph.mon.c.smithi168.stdout: block_size_deviation: 10 2019-12-22T22:25:08.848 INFO:ceph.mon.c.smithi168.stdout: block_restart_interval: 16 2019-12-22T22:25:08.849 INFO:ceph.mon.c.smithi168.stdout: index_block_restart_interval: 1 2019-12-22T22:25:08.849 INFO:ceph.mon.c.smithi168.stdout: metadata_block_size: 4096 2019-12-22T22:25:08.849 INFO:ceph.mon.c.smithi168.stdout: partition_filters: 0 2019-12-22T22:25:08.849 INFO:ceph.mon.c.smithi168.stdout: use_delta_encoding: 1 2019-12-22T22:25:08.849 INFO:ceph.mon.c.smithi168.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2019-12-22T22:25:08.849 INFO:ceph.mon.c.smithi168.stdout: whole_key_filtering: 1 2019-12-22T22:25:08.849 INFO:ceph.mon.c.smithi168.stdout: verify_compression: 0 2019-12-22T22:25:08.850 INFO:ceph.mon.c.smithi168.stdout: read_amp_bytes_per_bit: 0 2019-12-22T22:25:08.850 INFO:ceph.mon.c.smithi168.stdout: format_version: 2 2019-12-22T22:25:08.850 INFO:ceph.mon.c.smithi168.stdout: enable_index_compression: 1 2019-12-22T22:25:08.850 INFO:ceph.mon.c.smithi168.stdout: block_align: 0 2019-12-22T22:25:08.850 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.857 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.write_buffer_size: 33554432 2019-12-22T22:25:08.857 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_write_buffer_number: 2 2019-12-22T22:25:08.857 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compression: NoCompression 2019-12-22T22:25:08.857 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.bottommost_compression: Disabled 2019-12-22T22:25:08.858 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.prefix_extractor: nullptr 2019-12-22T22:25:08.858 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2019-12-22T22:25:08.858 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.num_levels: 7 2019-12-22T22:25:08.858 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2019-12-22T22:25:08.858 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2019-12-22T22:25:08.858 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2019-12-22T22:25:08.858 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2019-12-22T22:25:08.859 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2019-12-22T22:25:08.859 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2019-12-22T22:25:08.859 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2019-12-22T22:25:08.859 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2019-12-22T22:25:08.859 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compression_opts.window_bits: -14 2019-12-22T22:25:08.859 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compression_opts.level: 32767 2019-12-22T22:25:08.859 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compression_opts.strategy: 0 2019-12-22T22:25:08.860 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2019-12-22T22:25:08.860 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2019-12-22T22:25:08.860 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.compression_opts.enabled: false 2019-12-22T22:25:08.860 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2019-12-22T22:25:08.860 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2019-12-22T22:25:08.860 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2019-12-22T22:25:08.860 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.target_file_size_base: 67108864 2019-12-22T22:25:08.861 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.924+0000 7f9b938206c0 4 rocksdb: Options.target_file_size_multiplier: 1 2019-12-22T22:25:08.861 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2019-12-22T22:25:08.861 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2019-12-22T22:25:08.861 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2019-12-22T22:25:08.861 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2019-12-22T22:25:08.861 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2019-12-22T22:25:08.861 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2019-12-22T22:25:08.862 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2019-12-22T22:25:08.862 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2019-12-22T22:25:08.862 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2019-12-22T22:25:08.862 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2019-12-22T22:25:08.862 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2019-12-22T22:25:08.862 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2019-12-22T22:25:08.863 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.arena_block_size: 4194304 2019-12-22T22:25:08.863 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2019-12-22T22:25:08.863 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2019-12-22T22:25:08.863 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2019-12-22T22:25:08.863 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.disable_auto_compactions: 0 2019-12-22T22:25:08.863 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2019-12-22T22:25:08.863 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2019-12-22T22:25:08.864 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2019-12-22T22:25:08.864 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2019-12-22T22:25:08.864 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2019-12-22T22:25:08.864 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2019-12-22T22:25:08.864 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2019-12-22T22:25:08.864 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2019-12-22T22:25:08.864 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2019-12-22T22:25:08.865 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2019-12-22T22:25:08.865 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.table_properties_collectors: 2019-12-22T22:25:08.865 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.inplace_update_support: 0 2019-12-22T22:25:08.865 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2019-12-22T22:25:08.865 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2019-12-22T22:25:08.865 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2019-12-22T22:25:08.865 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.memtable_huge_page_size: 0 2019-12-22T22:25:08.866 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.bloom_locality: 0 2019-12-22T22:25:08.866 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.max_successive_merges: 0 2019-12-22T22:25:08.866 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2019-12-22T22:25:08.866 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.paranoid_file_checks: 0 2019-12-22T22:25:08.867 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.force_consistency_checks: 0 2019-12-22T22:25:08.867 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.report_bg_io_stats: 0 2019-12-22T22:25:08.867 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: Options.ttl: 0 2019-12-22T22:25:08.867 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2019-12-22T22:25:08.868 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.868 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2019-12-22T22:25:08.868 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.868 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053507926410, "job": 1, "event": "recovery_started", "log_files": [3]} 2019-12-22T22:25:08.868 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.925+0000 7f9b938206c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2019-12-22T22:25:08.868 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.926+0000 7f9b938206c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053507927197, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1368, "table_properties": {"data_size": 466, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 344, "raw_average_value_size": 68, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-22T22:25:08.869 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.926+0000 7f9b938206c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2019-12-22T22:25:08.869 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.869 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.927+0000 7f9b938206c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053507927809, "job": 1, "event": "recovery_finished"} 2019-12-22T22:25:08.869 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.928+0000 7f9b938206c0 4 rocksdb: DB pointer 0x556db85a3200 2019-12-22T22:25:08.870 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.928+0000 7f9b7a953700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2019-12-22T22:25:08.870 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.928+0000 7f9b7a953700 4 rocksdb: [db/db_impl.cc:778] 2019-12-22T22:25:08.870 INFO:ceph.mon.c.smithi168.stdout:** DB Stats ** 2019-12-22T22:25:08.870 INFO:ceph.mon.c.smithi168.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-22T22:25:08.870 INFO:ceph.mon.c.smithi168.stdout:Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2019-12-22T22:25:08.870 INFO:ceph.mon.c.smithi168.stdout:Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2019-12-22T22:25:08.870 INFO:ceph.mon.c.smithi168.stdout:Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-22T22:25:08.870 INFO:ceph.mon.c.smithi168.stdout:Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2019-12-22T22:25:08.871 INFO:ceph.mon.c.smithi168.stdout:Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2019-12-22T22:25:08.871 INFO:ceph.mon.c.smithi168.stdout:Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-22T22:25:08.871 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.871 INFO:ceph.mon.c.smithi168.stdout:** Compaction Stats [default] ** 2019-12-22T22:25:08.871 INFO:ceph.mon.c.smithi168.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:25:08.871 INFO:ceph.mon.c.smithi168.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:25:08.871 INFO:ceph.mon.c.smithi168.stdout: L0 1/0 1.34 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:08.872 INFO:ceph.mon.c.smithi168.stdout: Sum 1/0 1.34 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:08.872 INFO:ceph.mon.c.smithi168.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:08.872 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.872 INFO:ceph.mon.c.smithi168.stdout:** Compaction Stats [default] ** 2019-12-22T22:25:08.872 INFO:ceph.mon.c.smithi168.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:25:08.872 INFO:ceph.mon.c.smithi168.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:25:08.872 INFO:ceph.mon.c.smithi168.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:08.873 INFO:ceph.mon.c.smithi168.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-22T22:25:08.873 INFO:ceph.mon.c.smithi168.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-22T22:25:08.873 INFO:ceph.mon.c.smithi168.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-22T22:25:08.873 INFO:ceph.mon.c.smithi168.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-22T22:25:08.873 INFO:ceph.mon.c.smithi168.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-22T22:25:08.873 INFO:ceph.mon.c.smithi168.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-22T22:25:08.873 INFO:ceph.mon.c.smithi168.stdout:Cumulative compaction: 0.00 GB write, 0.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:25:08.874 INFO:ceph.mon.c.smithi168.stdout:Interval compaction: 0.00 GB write, 0.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:25:08.874 INFO:ceph.mon.c.smithi168.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-22T22:25:08.874 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.874 INFO:ceph.mon.c.smithi168.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-22T22:25:08.874 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.874 INFO:ceph.mon.c.smithi168.stdout:** Compaction Stats [default] ** 2019-12-22T22:25:08.874 INFO:ceph.mon.c.smithi168.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:25:08.875 INFO:ceph.mon.c.smithi168.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:25:08.875 INFO:ceph.mon.c.smithi168.stdout: L0 1/0 1.34 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:08.875 INFO:ceph.mon.c.smithi168.stdout: Sum 1/0 1.34 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:08.875 INFO:ceph.mon.c.smithi168.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2019-12-22T22:25:08.875 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.875 INFO:ceph.mon.c.smithi168.stdout:** Compaction Stats [default] ** 2019-12-22T22:25:08.875 INFO:ceph.mon.c.smithi168.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:25:08.875 INFO:ceph.mon.c.smithi168.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:25:08.876 INFO:ceph.mon.c.smithi168.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:08.876 INFO:ceph.mon.c.smithi168.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-22T22:25:08.876 INFO:ceph.mon.c.smithi168.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-22T22:25:08.876 INFO:ceph.mon.c.smithi168.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-22T22:25:08.876 INFO:ceph.mon.c.smithi168.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-22T22:25:08.876 INFO:ceph.mon.c.smithi168.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-22T22:25:08.876 INFO:ceph.mon.c.smithi168.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-22T22:25:08.877 INFO:ceph.mon.c.smithi168.stdout:Cumulative compaction: 0.00 GB write, 0.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:25:08.877 INFO:ceph.mon.c.smithi168.stdout:Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:25:08.877 INFO:ceph.mon.c.smithi168.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-22T22:25:08.877 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.877 INFO:ceph.mon.c.smithi168.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-22T22:25:08.877 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.877 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.928+0000 7f9b938206c0 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2019-12-22T22:25:08.878 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.929+0000 7f9b938206c0 0 using public_addrv v1:172.21.15.168:6789/0 2019-12-22T22:25:08.878 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.929+0000 7f9b938206c0 0 starting mon.c rank -1 at public addrs v1:172.21.15.168:6789/0 at bind addrs v1:172.21.15.168:6789/0 mon_data /var/lib/ceph/mon/ceph-c fsid 7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:25:08.878 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.930+0000 7f9b938206c0 1 mon.c@-1(???) e0 preinit fsid 7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:25:08.878 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.954+0000 7f9b7894f700 4 rocksdb: [db/db_impl_write.cc:1470] [default] New memtable created with log file: #9. Immutable memtables: 0. 2019-12-22T22:25:08.878 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.878 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.954+0000 7f9b82963700 4 rocksdb: (Original Log Time 2019/12/22-22:25:07.954886) [db/db_impl_compaction_flush.cc:2073] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2019-12-22T22:25:08.878 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.954+0000 7f9b82963700 4 rocksdb: [db/flush_job.cc:322] [default] [JOB 3] Flushing memtable with next log file: 9 2019-12-22T22:25:08.879 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.879 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.954+0000 7f9b82963700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053507954938, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 789, "num_deletes": 22, "total_data_size": 2089787, "memory_usage": 2104656, "flush_reason": "Manual Compaction"} 2019-12-22T22:25:08.879 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.954+0000 7f9b82963700 4 rocksdb: [db/flush_job.cc:351] [default] [JOB 3] Level-0 flush table #10: started 2019-12-22T22:25:08.879 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.956+0000 7f9b7d158700 0 mon.c@-1(synchronizing).mds e1 new map 2019-12-22T22:25:08.879 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.956+0000 7f9b7d158700 0 mon.c@-1(synchronizing).mds e1 print_map 2019-12-22T22:25:08.879 INFO:ceph.mon.c.smithi168.stdout:e1 2019-12-22T22:25:08.879 INFO:ceph.mon.c.smithi168.stdout:enable_multiple, ever_enabled_multiple: 0,0 2019-12-22T22:25:08.880 INFO:ceph.mon.c.smithi168.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2019-12-22T22:25:08.880 INFO:ceph.mon.c.smithi168.stdout:legacy client fscid: -1 2019-12-22T22:25:08.880 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.880 INFO:ceph.mon.c.smithi168.stdout:No filesystems configured 2019-12-22T22:25:08.880 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.880 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.957+0000 7f9b7d158700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2019-12-22T22:25:08.880 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.957+0000 7f9b7d158700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2019-12-22T22:25:08.881 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.957+0000 7f9b7d158700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2019-12-22T22:25:08.881 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b82963700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053507958730, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 10, "file_size": 1948423, "table_properties": {"data_size": 1943250, "index_size": 3134, "filter_size": 1221, "raw_key_size": 15488, "raw_average_key_size": 33, "raw_value_size": 1931983, "raw_average_value_size": 4199, "num_data_blocks": 104, "num_entries": 460, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-22T22:25:08.881 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b82963700 4 rocksdb: [db/flush_job.cc:392] [default] [JOB 3] Level-0 flush table #10: 1948423 bytes OK 2019-12-22T22:25:08.881 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b7d158700 0 mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-22T22:25:08.881 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b7d158700 0 mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-22T22:25:08.881 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b7d158700 0 mon.c@-1(synchronizing).osd e3 crush map has features 3314932999778484224, adjusting msgr requires 2019-12-22T22:25:08.881 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b7d158700 0 mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-22T22:25:08.882 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b82963700 4 rocksdb: (Original Log Time 2019/12/22-22:25:07.958783) [db/memtable_list.cc:380] [default] Level-0 commit table #10 started 2019-12-22T22:25:08.882 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b82963700 4 rocksdb: (Original Log Time 2019/12/22-22:25:07.959517) [db/memtable_list.cc:428] [default] Level-0 commit table #10: memtable #1 done 2019-12-22T22:25:08.882 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b82963700 4 rocksdb: (Original Log Time 2019/12/22-22:25:07.959534) EVENT_LOG_v1 {"time_micros": 1577053507959525, "job": 3, "event": "flush_finished", "output_compression": "NoCompression", "lsm_state": [2, 0, 0, 0, 0, 0, 0], "immutable_memtables": 0} 2019-12-22T22:25:08.882 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b82963700 4 rocksdb: (Original Log Time 2019/12/22-22:25:07.959552) [db/db_impl_compaction_flush.cc:201] [default] Level summary: files[2 0 0 0 0 0 0] max score 0.50 2019-12-22T22:25:08.882 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.882 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b82963700 4 rocksdb: [db/db_impl_files.cc:356] [JOB 3] Try to delete WAL files size 2084266, prev total WAL file size 2470002, number of live WAL files 2. 2019-12-22T22:25:08.882 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.883 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.958+0000 7f9b7894f700 4 rocksdb: [db/db_impl_compaction_flush.cc:1403] [default] Manual compaction starting 2019-12-22T22:25:08.883 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.959+0000 7f9b83164700 4 rocksdb: (Original Log Time 2019/12/22-22:25:07.959738) [db/db_impl_compaction_flush.cc:2374] [default] Manual compaction from level-0 to level-6 from 'mgrstat .. 'mgrstat; will stop at (end) 2019-12-22T22:25:08.883 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.883 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.959+0000 7f9b83164700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 4] Compacting 2@0 files to L6, score -1.00 2019-12-22T22:25:08.883 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.959+0000 7f9b83164700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 3 Base level 0, inputs: [10(1902KB) 4(1368B)] 2019-12-22T22:25:08.883 INFO:ceph.mon.c.smithi168.stdout: 2019-12-22T22:25:08.883 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.959+0000 7f9b7d158700 1 mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2019-12-22T22:25:08.883 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.959+0000 7f9b83164700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053507959841, "job": 4, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L0": [10, 4], "score": -1, "input_data_size": 1949791} 2019-12-22T22:25:08.884 INFO:ceph.mon.c.smithi168.stdout:2019-12-22T22:25:07.960+0000 7f9b7d158700 10 mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_osdmap_full_prune_interval,mon_osdmap_full_prune_min,mon_osdmap_full_prune_txsize 2019-12-22T22:25:23.268 INFO:teuthology.orchestra.run.smithi168.stdout: 2019-12-22T22:25:23.269 INFO:teuthology.orchestra.run.smithi168.stdout:{"epoch":2,"fsid":"7a4dd340-2509-11ea-8284-001a4aab830c","modified":"2019-12-22T22:25:07.962455Z","created":"2019-12-22T22:22:45.829176Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6789","nonce":0}]},"addr":"172.21.15.168:6789/0","public_addr":"172.21.15.168:6789/0","priority":0,"weight":0}],"quorum":[0,1]} 2019-12-22T22:25:23.270 INFO:teuthology.orchestra.run.smithi168.stderr:dumped monmap epoch 2 2019-12-22T22:25:23.771 INFO:tasks.cephadm:Adding mon.b on smithi187 2019-12-22T22:25:23.771 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator mon update 3 'smithi187:[v1:172.21.15.187:6789]=b' 2019-12-22T22:25:26.372 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:25:27.373 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:25:31.132 INFO:teuthology.orchestra.run.smithi187.stdout:["(Re)deployed mon.b on host 'smithi187'"] 2019-12-22T22:25:31.898 INFO:teuthology.orchestra.run.smithi187:mon.b> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name mon.b 2019-12-22T22:25:31.904 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2019-12-22T22:25:31.905 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph mon dump -f json 2019-12-22T22:25:32.195 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.317+0000 7fd3d81d16c0 0 set uid:gid to 167:167 (ceph:ceph) 2019-12-22T22:25:32.195 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.317+0000 7fd3d81d16c0 0 ceph version 15.0.0-8807-g99b509f (99b509ffd4dd354919b08b38ba83b998fbfdc107) octopus (dev), process ceph-mon, pid 1 2019-12-22T22:25:32.195 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.317+0000 7fd3d81d16c0 0 pidfile_write: ignore empty --pid-file 2019-12-22T22:25:32.195 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.322+0000 7fd3d81d16c0 0 load: jerasure load: lrc load: isa 2019-12-22T22:25:32.195 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.322+0000 7fd3d81d16c0 0 set rocksdb option compression = kNoCompression 2019-12-22T22:25:32.195 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-22T22:25:32.196 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-22T22:25:32.196 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 0 set rocksdb option compression = kNoCompression 2019-12-22T22:25:32.196 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2019-12-22T22:25:32.196 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 0 set rocksdb option write_buffer_size = 33554432 2019-12-22T22:25:32.196 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 1 rocksdb: do_open column families: [default] 2019-12-22T22:25:32.196 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: RocksDB version: 6.1.2 2019-12-22T22:25:32.197 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.197 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2019-12-22T22:25:32.197 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Compile date Dec 22 2019 2019-12-22T22:25:32.197 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: DB SUMMARY 2019-12-22T22:25:32.197 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.197 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: CURRENT file: CURRENT 2019-12-22T22:25:32.197 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.197 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: IDENTITY file: IDENTITY 2019-12-22T22:25:32.198 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.198 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2019-12-22T22:25:32.198 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.198 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2019-12-22T22:25:32.198 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.198 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 540 ; 2019-12-22T22:25:32.198 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.199 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.error_if_exists: 0 2019-12-22T22:25:32.199 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.create_if_missing: 0 2019-12-22T22:25:32.199 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.paranoid_checks: 1 2019-12-22T22:25:32.199 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.env: 0x5558a957e260 2019-12-22T22:25:32.199 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.info_log: 0x5558abd1e4a0 2019-12-22T22:25:32.199 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.max_file_opening_threads: 16 2019-12-22T22:25:32.199 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.statistics: (nil) 2019-12-22T22:25:32.200 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.use_fsync: 0 2019-12-22T22:25:32.200 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.max_log_file_size: 0 2019-12-22T22:25:32.200 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2019-12-22T22:25:32.200 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.log_file_time_to_roll: 0 2019-12-22T22:25:32.200 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.keep_log_file_num: 1000 2019-12-22T22:25:32.200 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.recycle_log_file_num: 0 2019-12-22T22:25:32.200 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.allow_fallocate: 1 2019-12-22T22:25:32.201 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.allow_mmap_reads: 0 2019-12-22T22:25:32.201 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.allow_mmap_writes: 0 2019-12-22T22:25:32.201 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.use_direct_reads: 0 2019-12-22T22:25:32.201 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2019-12-22T22:25:32.201 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.create_missing_column_families: 0 2019-12-22T22:25:32.201 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.db_log_dir: 2019-12-22T22:25:32.201 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2019-12-22T22:25:32.201 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.table_cache_numshardbits: 6 2019-12-22T22:25:32.202 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.max_subcompactions: 1 2019-12-22T22:25:32.202 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.max_background_flushes: -1 2019-12-22T22:25:32.202 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2019-12-22T22:25:32.202 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2019-12-22T22:25:32.202 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2019-12-22T22:25:32.202 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2019-12-22T22:25:32.202 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.advise_random_on_open: 1 2019-12-22T22:25:32.203 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.db_write_buffer_size: 0 2019-12-22T22:25:32.203 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.write_buffer_manager: 0x5558ac8c6a50 2019-12-22T22:25:32.203 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2019-12-22T22:25:32.203 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2019-12-22T22:25:32.203 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2019-12-22T22:25:32.203 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.use_adaptive_mutex: 0 2019-12-22T22:25:32.203 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.rate_limiter: (nil) 2019-12-22T22:25:32.204 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2019-12-22T22:25:32.204 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.wal_recovery_mode: 2 2019-12-22T22:25:32.204 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.enable_thread_tracking: 0 2019-12-22T22:25:32.204 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.enable_pipelined_write: 0 2019-12-22T22:25:32.204 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2019-12-22T22:25:32.204 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2019-12-22T22:25:32.204 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2019-12-22T22:25:32.205 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2019-12-22T22:25:32.205 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.row_cache: None 2019-12-22T22:25:32.205 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.wal_filter: None 2019-12-22T22:25:32.205 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2019-12-22T22:25:32.205 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.allow_ingest_behind: 0 2019-12-22T22:25:32.205 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.preserve_deletes: 0 2019-12-22T22:25:32.205 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.two_write_queues: 0 2019-12-22T22:25:32.209 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.manual_wal_flush: 0 2019-12-22T22:25:32.209 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.atomic_flush: 0 2019-12-22T22:25:32.209 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2019-12-22T22:25:32.209 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.max_background_jobs: 2 2019-12-22T22:25:32.209 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.max_background_compactions: -1 2019-12-22T22:25:32.209 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2019-12-22T22:25:32.210 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2019-12-22T22:25:32.210 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.delayed_write_rate : 16777216 2019-12-22T22:25:32.210 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.max_total_wal_size: 0 2019-12-22T22:25:32.210 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2019-12-22T22:25:32.210 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.stats_dump_period_sec: 600 2019-12-22T22:25:32.210 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.stats_persist_period_sec: 600 2019-12-22T22:25:32.210 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2019-12-22T22:25:32.211 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.max_open_files: -1 2019-12-22T22:25:32.211 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.bytes_per_sync: 0 2019-12-22T22:25:32.211 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2019-12-22T22:25:32.211 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_readahead_size: 0 2019-12-22T22:25:32.211 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Compression algorithms supported: 2019-12-22T22:25:32.211 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2019-12-22T22:25:32.211 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: kZSTD supported: 0 2019-12-22T22:25:32.212 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: kXpressCompression supported: 0 2019-12-22T22:25:32.212 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: kLZ4HCCompression supported: 1 2019-12-22T22:25:32.212 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: kLZ4Compression supported: 1 2019-12-22T22:25:32.212 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: kBZip2Compression supported: 0 2019-12-22T22:25:32.212 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: kZlibCompression supported: 1 2019-12-22T22:25:32.212 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: kSnappyCompression supported: 1 2019-12-22T22:25:32.213 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.323+0000 7fd3d81d16c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2019-12-22T22:25:32.213 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2019-12-22T22:25:32.213 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.213 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2019-12-22T22:25:32.213 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.213 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2019-12-22T22:25:32.213 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.merge_operator: 2019-12-22T22:25:32.214 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_filter: None 2019-12-22T22:25:32.214 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_filter_factory: None 2019-12-22T22:25:32.214 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2019-12-22T22:25:32.214 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.table_factory: BlockBasedTable 2019-12-22T22:25:32.214 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5558abc3a0c8) 2019-12-22T22:25:32.214 INFO:ceph.mon.b.smithi187.stdout: cache_index_and_filter_blocks: 1 2019-12-22T22:25:32.214 INFO:ceph.mon.b.smithi187.stdout: cache_index_and_filter_blocks_with_high_priority: 1 2019-12-22T22:25:32.215 INFO:ceph.mon.b.smithi187.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2019-12-22T22:25:32.215 INFO:ceph.mon.b.smithi187.stdout: pin_top_level_index_and_filter: 1 2019-12-22T22:25:32.215 INFO:ceph.mon.b.smithi187.stdout: index_type: 0 2019-12-22T22:25:32.215 INFO:ceph.mon.b.smithi187.stdout: data_block_index_type: 0 2019-12-22T22:25:32.215 INFO:ceph.mon.b.smithi187.stdout: data_block_hash_table_util_ratio: 0.750000 2019-12-22T22:25:32.215 INFO:ceph.mon.b.smithi187.stdout: hash_index_allow_collision: 1 2019-12-22T22:25:32.215 INFO:ceph.mon.b.smithi187.stdout: checksum: 1 2019-12-22T22:25:32.216 INFO:ceph.mon.b.smithi187.stdout: no_block_cache: 0 2019-12-22T22:25:32.216 INFO:ceph.mon.b.smithi187.stdout: block_cache: 0x5558abc74210 2019-12-22T22:25:32.216 INFO:ceph.mon.b.smithi187.stdout: block_cache_name: BinnedLRUCache 2019-12-22T22:25:32.216 INFO:ceph.mon.b.smithi187.stdout: block_cache_options: 2019-12-22T22:25:32.216 INFO:ceph.mon.b.smithi187.stdout: capacity : 536870912 2019-12-22T22:25:32.216 INFO:ceph.mon.b.smithi187.stdout: num_shard_bits : 4 2019-12-22T22:25:32.216 INFO:ceph.mon.b.smithi187.stdout: strict_capacity_limit : 0 2019-12-22T22:25:32.217 INFO:ceph.mon.b.smithi187.stdout: high_pri_pool_ratio: 0.000 2019-12-22T22:25:32.217 INFO:ceph.mon.b.smithi187.stdout: block_cache_compressed: (nil) 2019-12-22T22:25:32.217 INFO:ceph.mon.b.smithi187.stdout: persistent_cache: (nil) 2019-12-22T22:25:32.217 INFO:ceph.mon.b.smithi187.stdout: block_size: 4096 2019-12-22T22:25:32.217 INFO:ceph.mon.b.smithi187.stdout: block_size_deviation: 10 2019-12-22T22:25:32.217 INFO:ceph.mon.b.smithi187.stdout: block_restart_interval: 16 2019-12-22T22:25:32.217 INFO:ceph.mon.b.smithi187.stdout: index_block_restart_interval: 1 2019-12-22T22:25:32.218 INFO:ceph.mon.b.smithi187.stdout: metadata_block_size: 4096 2019-12-22T22:25:32.218 INFO:ceph.mon.b.smithi187.stdout: partition_filters: 0 2019-12-22T22:25:32.218 INFO:ceph.mon.b.smithi187.stdout: use_delta_encoding: 1 2019-12-22T22:25:32.218 INFO:ceph.mon.b.smithi187.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2019-12-22T22:25:32.218 INFO:ceph.mon.b.smithi187.stdout: whole_key_filtering: 1 2019-12-22T22:25:32.218 INFO:ceph.mon.b.smithi187.stdout: verify_compression: 0 2019-12-22T22:25:32.218 INFO:ceph.mon.b.smithi187.stdout: read_amp_bytes_per_bit: 0 2019-12-22T22:25:32.219 INFO:ceph.mon.b.smithi187.stdout: format_version: 2 2019-12-22T22:25:32.219 INFO:ceph.mon.b.smithi187.stdout: enable_index_compression: 1 2019-12-22T22:25:32.219 INFO:ceph.mon.b.smithi187.stdout: block_align: 0 2019-12-22T22:25:32.219 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.219 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.write_buffer_size: 33554432 2019-12-22T22:25:32.219 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_write_buffer_number: 2 2019-12-22T22:25:32.219 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compression: NoCompression 2019-12-22T22:25:32.220 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.bottommost_compression: Disabled 2019-12-22T22:25:32.220 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.prefix_extractor: nullptr 2019-12-22T22:25:32.220 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2019-12-22T22:25:32.220 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.num_levels: 7 2019-12-22T22:25:32.220 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2019-12-22T22:25:32.220 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2019-12-22T22:25:32.220 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2019-12-22T22:25:32.221 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2019-12-22T22:25:32.221 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2019-12-22T22:25:32.221 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2019-12-22T22:25:32.221 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2019-12-22T22:25:32.221 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2019-12-22T22:25:32.221 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compression_opts.window_bits: -14 2019-12-22T22:25:32.221 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compression_opts.level: 32767 2019-12-22T22:25:32.222 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compression_opts.strategy: 0 2019-12-22T22:25:32.222 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2019-12-22T22:25:32.222 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2019-12-22T22:25:32.222 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compression_opts.enabled: false 2019-12-22T22:25:32.222 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2019-12-22T22:25:32.222 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2019-12-22T22:25:32.222 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2019-12-22T22:25:32.223 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.target_file_size_base: 67108864 2019-12-22T22:25:32.223 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.target_file_size_multiplier: 1 2019-12-22T22:25:32.223 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2019-12-22T22:25:32.223 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2019-12-22T22:25:32.223 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2019-12-22T22:25:32.223 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2019-12-22T22:25:32.224 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2019-12-22T22:25:32.224 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2019-12-22T22:25:32.224 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2019-12-22T22:25:32.224 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2019-12-22T22:25:32.224 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2019-12-22T22:25:32.224 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2019-12-22T22:25:32.225 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2019-12-22T22:25:32.225 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2019-12-22T22:25:32.225 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.arena_block_size: 4194304 2019-12-22T22:25:32.225 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2019-12-22T22:25:32.225 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2019-12-22T22:25:32.225 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2019-12-22T22:25:32.225 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.disable_auto_compactions: 0 2019-12-22T22:25:32.226 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2019-12-22T22:25:32.226 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2019-12-22T22:25:32.226 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2019-12-22T22:25:32.226 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2019-12-22T22:25:32.226 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2019-12-22T22:25:32.226 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2019-12-22T22:25:32.226 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2019-12-22T22:25:32.227 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2019-12-22T22:25:32.227 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2019-12-22T22:25:32.227 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2019-12-22T22:25:32.227 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.table_properties_collectors: 2019-12-22T22:25:32.227 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.inplace_update_support: 0 2019-12-22T22:25:32.227 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2019-12-22T22:25:32.227 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2019-12-22T22:25:32.228 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2019-12-22T22:25:32.228 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.memtable_huge_page_size: 0 2019-12-22T22:25:32.228 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.bloom_locality: 0 2019-12-22T22:25:32.228 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.max_successive_merges: 0 2019-12-22T22:25:32.230 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2019-12-22T22:25:32.231 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.paranoid_file_checks: 0 2019-12-22T22:25:32.231 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.force_consistency_checks: 0 2019-12-22T22:25:32.231 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.report_bg_io_stats: 0 2019-12-22T22:25:32.231 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: Options.ttl: 0 2019-12-22T22:25:32.232 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2019-12-22T22:25:32.232 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.232 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2019-12-22T22:25:32.232 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.232 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053531326036, "job": 1, "event": "recovery_started", "log_files": [3]} 2019-12-22T22:25:32.232 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.324+0000 7fd3d81d16c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2019-12-22T22:25:32.233 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.325+0000 7fd3d81d16c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053531326710, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1454, "table_properties": {"data_size": 552, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 430, "raw_average_value_size": 86, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-22T22:25:32.233 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.325+0000 7fd3d81d16c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2019-12-22T22:25:32.233 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.233 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.326+0000 7fd3d81d16c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053531327326, "job": 1, "event": "recovery_finished"} 2019-12-22T22:25:32.233 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.327+0000 7fd3d81d16c0 4 rocksdb: DB pointer 0x5558ac8a9200 2019-12-22T22:25:32.233 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.327+0000 7fd3bf304700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2019-12-22T22:25:32.233 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.327+0000 7fd3bf304700 4 rocksdb: [db/db_impl.cc:778] 2019-12-22T22:25:32.234 INFO:ceph.mon.b.smithi187.stdout:** DB Stats ** 2019-12-22T22:25:32.234 INFO:ceph.mon.b.smithi187.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-22T22:25:32.234 INFO:ceph.mon.b.smithi187.stdout:Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2019-12-22T22:25:32.234 INFO:ceph.mon.b.smithi187.stdout:Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2019-12-22T22:25:32.234 INFO:ceph.mon.b.smithi187.stdout:Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-22T22:25:32.234 INFO:ceph.mon.b.smithi187.stdout:Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2019-12-22T22:25:32.234 INFO:ceph.mon.b.smithi187.stdout:Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2019-12-22T22:25:32.235 INFO:ceph.mon.b.smithi187.stdout:Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2019-12-22T22:25:32.235 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.235 INFO:ceph.mon.b.smithi187.stdout:** Compaction Stats [default] ** 2019-12-22T22:25:32.235 INFO:ceph.mon.b.smithi187.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:25:32.236 INFO:ceph.mon.b.smithi187.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:25:32.236 INFO:ceph.mon.b.smithi187.stdout: L0 1/0 1.42 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:32.236 INFO:ceph.mon.b.smithi187.stdout: Sum 1/0 1.42 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:32.236 INFO:ceph.mon.b.smithi187.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:32.236 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.237 INFO:ceph.mon.b.smithi187.stdout:** Compaction Stats [default] ** 2019-12-22T22:25:32.237 INFO:ceph.mon.b.smithi187.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:25:32.237 INFO:ceph.mon.b.smithi187.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:25:32.237 INFO:ceph.mon.b.smithi187.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:32.238 INFO:ceph.mon.b.smithi187.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-22T22:25:32.238 INFO:ceph.mon.b.smithi187.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-22T22:25:32.238 INFO:ceph.mon.b.smithi187.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-22T22:25:32.238 INFO:ceph.mon.b.smithi187.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-22T22:25:32.238 INFO:ceph.mon.b.smithi187.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-22T22:25:32.238 INFO:ceph.mon.b.smithi187.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-22T22:25:32.239 INFO:ceph.mon.b.smithi187.stdout:Cumulative compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:25:32.239 INFO:ceph.mon.b.smithi187.stdout:Interval compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:25:32.239 INFO:ceph.mon.b.smithi187.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-22T22:25:32.239 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.239 INFO:ceph.mon.b.smithi187.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-22T22:25:32.240 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.240 INFO:ceph.mon.b.smithi187.stdout:** Compaction Stats [default] ** 2019-12-22T22:25:32.240 INFO:ceph.mon.b.smithi187.stdout:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:25:32.240 INFO:ceph.mon.b.smithi187.stdout:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:25:32.240 INFO:ceph.mon.b.smithi187.stdout: L0 1/0 1.42 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:32.240 INFO:ceph.mon.b.smithi187.stdout: Sum 1/0 1.42 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:32.240 INFO:ceph.mon.b.smithi187.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2019-12-22T22:25:32.241 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.241 INFO:ceph.mon.b.smithi187.stdout:** Compaction Stats [default] ** 2019-12-22T22:25:32.241 INFO:ceph.mon.b.smithi187.stdout:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2019-12-22T22:25:32.241 INFO:ceph.mon.b.smithi187.stdout:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2019-12-22T22:25:32.241 INFO:ceph.mon.b.smithi187.stdout:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2019-12-22T22:25:32.241 INFO:ceph.mon.b.smithi187.stdout:Uptime(secs): 0.0 total, 0.0 interval 2019-12-22T22:25:32.241 INFO:ceph.mon.b.smithi187.stdout:Flush(GB): cumulative 0.000, interval 0.000 2019-12-22T22:25:32.242 INFO:ceph.mon.b.smithi187.stdout:AddFile(GB): cumulative 0.000, interval 0.000 2019-12-22T22:25:32.242 INFO:ceph.mon.b.smithi187.stdout:AddFile(Total Files): cumulative 0, interval 0 2019-12-22T22:25:32.242 INFO:ceph.mon.b.smithi187.stdout:AddFile(L0 Files): cumulative 0, interval 0 2019-12-22T22:25:32.242 INFO:ceph.mon.b.smithi187.stdout:AddFile(Keys): cumulative 0, interval 0 2019-12-22T22:25:32.242 INFO:ceph.mon.b.smithi187.stdout:Cumulative compaction: 0.00 GB write, 0.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:25:32.242 INFO:ceph.mon.b.smithi187.stdout:Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2019-12-22T22:25:32.242 INFO:ceph.mon.b.smithi187.stdout:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2019-12-22T22:25:32.243 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.243 INFO:ceph.mon.b.smithi187.stdout:** File Read Latency Histogram By Level [default] ** 2019-12-22T22:25:32.243 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.243 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.327+0000 7fd3d81d16c0 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2019-12-22T22:25:32.243 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.328+0000 7fd3d81d16c0 0 using public_addrv v1:172.21.15.187:6789/0 2019-12-22T22:25:32.244 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.328+0000 7fd3d81d16c0 0 starting mon.b rank -1 at public addrs v1:172.21.15.187:6789/0 at bind addrs v1:172.21.15.187:6789/0 mon_data /var/lib/ceph/mon/ceph-b fsid 7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:25:32.244 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.329+0000 7fd3d81d16c0 1 mon.b@-1(???) e0 preinit fsid 7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:25:32.244 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.352+0000 7fd3bd300700 4 rocksdb: [db/db_impl_write.cc:1470] [default] New memtable created with log file: #9. Immutable memtables: 0. 2019-12-22T22:25:32.244 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.244 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.352+0000 7fd3c7314700 4 rocksdb: (Original Log Time 2019/12/22-22:25:31.353296) [db/db_impl_compaction_flush.cc:2073] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2019-12-22T22:25:32.244 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.352+0000 7fd3c7314700 4 rocksdb: [db/flush_job.cc:322] [default] [JOB 3] Flushing memtable with next log file: 9 2019-12-22T22:25:32.244 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.245 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.352+0000 7fd3c7314700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053531353360, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 789, "num_deletes": 22, "total_data_size": 2089787, "memory_usage": 2104840, "flush_reason": "Manual Compaction"} 2019-12-22T22:25:32.245 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.352+0000 7fd3c7314700 4 rocksdb: [db/flush_job.cc:351] [default] [JOB 3] Level-0 flush table #10: started 2019-12-22T22:25:32.245 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.354+0000 7fd3c7314700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053531356099, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 10, "file_size": 1948423, "table_properties": {"data_size": 1943250, "index_size": 3134, "filter_size": 1221, "raw_key_size": 15488, "raw_average_key_size": 33, "raw_value_size": 1931983, "raw_average_value_size": 4199, "num_data_blocks": 104, "num_entries": 460, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-22T22:25:32.245 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.354+0000 7fd3c7314700 4 rocksdb: [db/flush_job.cc:392] [default] [JOB 3] Level-0 flush table #10: 1948423 bytes OK 2019-12-22T22:25:32.245 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3c7314700 4 rocksdb: (Original Log Time 2019/12/22-22:25:31.356142) [db/memtable_list.cc:380] [default] Level-0 commit table #10 started 2019-12-22T22:25:32.245 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3c7314700 4 rocksdb: (Original Log Time 2019/12/22-22:25:31.358168) [db/memtable_list.cc:428] [default] Level-0 commit table #10: memtable #1 done 2019-12-22T22:25:32.245 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3c7314700 4 rocksdb: (Original Log Time 2019/12/22-22:25:31.358185) EVENT_LOG_v1 {"time_micros": 1577053531358176, "job": 3, "event": "flush_finished", "output_compression": "NoCompression", "lsm_state": [2, 0, 0, 0, 0, 0, 0], "immutable_memtables": 0} 2019-12-22T22:25:32.246 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3c7314700 4 rocksdb: (Original Log Time 2019/12/22-22:25:31.358198) [db/db_impl_compaction_flush.cc:201] [default] Level summary: files[2 0 0 0 0 0 0] max score 0.50 2019-12-22T22:25:32.246 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.246 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3c7314700 4 rocksdb: [db/db_impl_files.cc:356] [JOB 3] Try to delete WAL files size 2084266, prev total WAL file size 2512112, number of live WAL files 2. 2019-12-22T22:25:32.246 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.246 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3bd300700 4 rocksdb: [db/db_impl_compaction_flush.cc:1403] [default] Manual compaction starting 2019-12-22T22:25:32.247 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3c7b15700 4 rocksdb: (Original Log Time 2019/12/22-22:25:31.358445) [db/db_impl_compaction_flush.cc:2374] [default] Manual compaction from level-0 to level-6 from 'mgrstat .. 'mgrstat; will stop at (end) 2019-12-22T22:25:32.247 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.247 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3c7b15700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 4] Compacting 2@0 files to L6, score -1.00 2019-12-22T22:25:32.247 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3c7b15700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 3 Base level 0, inputs: [10(1902KB) 4(1454B)] 2019-12-22T22:25:32.247 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.248 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.357+0000 7fd3c7b15700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053531358503, "job": 4, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L0": [10, 4], "score": -1, "input_data_size": 1949877} 2019-12-22T22:25:32.248 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.358+0000 7fd3c1b09700 0 mon.b@-1(synchronizing).mds e1 new map 2019-12-22T22:25:32.248 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.358+0000 7fd3c1b09700 0 mon.b@-1(synchronizing).mds e1 print_map 2019-12-22T22:25:32.248 INFO:ceph.mon.b.smithi187.stdout:e1 2019-12-22T22:25:32.248 INFO:ceph.mon.b.smithi187.stdout:enable_multiple, ever_enabled_multiple: 0,0 2019-12-22T22:25:32.248 INFO:ceph.mon.b.smithi187.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2019-12-22T22:25:32.249 INFO:ceph.mon.b.smithi187.stdout:legacy client fscid: -1 2019-12-22T22:25:32.249 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.249 INFO:ceph.mon.b.smithi187.stdout:No filesystems configured 2019-12-22T22:25:32.249 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.249 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.359+0000 7fd3c1b09700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2019-12-22T22:25:32.249 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.359+0000 7fd3c1b09700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2019-12-22T22:25:32.249 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.359+0000 7fd3c1b09700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2019-12-22T22:25:32.250 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.359+0000 7fd3c1b09700 0 mon.b@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-22T22:25:32.250 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.359+0000 7fd3c1b09700 0 mon.b@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-22T22:25:32.250 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.359+0000 7fd3c1b09700 0 mon.b@-1(synchronizing).osd e3 crush map has features 3314932999778484224, adjusting msgr requires 2019-12-22T22:25:32.250 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.359+0000 7fd3c1b09700 0 mon.b@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2019-12-22T22:25:32.250 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.359+0000 7fd3c1b09700 1 mon.b@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2019-12-22T22:25:32.250 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.360+0000 7fd3c7b15700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 4] Generated table #11: 443 keys, 1948776 bytes 2019-12-22T22:25:32.250 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.360+0000 7fd3c7b15700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1577053531361967, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 11, "file_size": 1948776, "table_properties": {"data_size": 1943599, "index_size": 3142, "filter_size": 1221, "raw_key_size": 15216, "raw_average_key_size": 34, "raw_value_size": 1932413, "raw_average_value_size": 4362, "num_data_blocks": 104, "num_entries": 443, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2019-12-22T22:25:32.251 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.361+0000 7fd3c7b15700 4 rocksdb: [db/compaction_job.cc:1395] [default] [JOB 4] Compacted 2@0 files to L6 => 1948776 bytes 2019-12-22T22:25:32.251 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.361+0000 7fd3c7b15700 3 rocksdb: [db/version_set.cc:2581] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2019-12-22T22:25:32.251 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.361+0000 7fd3c7b15700 4 rocksdb: (Original Log Time 2019/12/22-22:25:31.362319) [db/compaction_job.cc:768] [default] compacted to: base level 6 level multiplier 10.00 max bytes base 268435456 files[0 0 0 0 0 0 1] max score 0.00, MB/sec: 560.1 rd, 559.8 wr, level 6, files in(2, 0) out(1) MB in(1.9, 0.0) out(1.9), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 465, records dropped: 22 output_compression: NoCompression 2019-12-22T22:25:32.251 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:32.251 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.361+0000 7fd3c7b15700 4 rocksdb: (Original Log Time 2019/12/22-22:25:31.362337) EVENT_LOG_v1 {"time_micros": 1577053531362329, "job": 4, "event": "compaction_finished", "compaction_time_micros": 3481, "compaction_time_cpu_micros": 3046, "output_level": 6, "num_output_files": 1, "total_output_size": 1948776, "num_input_records": 465, "num_output_records": 443, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 0, 0, 0, 0, 0, 1]} 2019-12-22T22:25:32.251 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.361+0000 7fd3c1b09700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete,mon_osdmap_full_prune_interval,mon_osdmap_full_prune_min,mon_osdmap_full_prune_txsize 2019-12-22T22:25:32.251 INFO:ceph.mon.b.smithi187.stdout:2019-12-22T22:25:31.361+0000 7fd3bd300700 4 rocksdb: [db/db_impl_write.cc:1470] [default] New memtable created with log file: #12. Immutable memtables: 0. 2019-12-22T22:25:32.252 INFO:ceph.mon.b.smithi187.stdout: 2019-12-22T22:25:36.662 INFO:teuthology.orchestra.run.smithi187.stdout: 2019-12-22T22:25:36.662 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":3,"fsid":"7a4dd340-2509-11ea-8284-001a4aab830c","modified":"2019-12-22T22:25:31.366101Z","created":"2019-12-22T22:22:45.829176Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6789","nonce":0}]},"addr":"172.21.15.168:6789/0","public_addr":"172.21.15.168:6789/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2019-12-22T22:25:36.663 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 3 2019-12-22T22:25:37.149 INFO:tasks.cephadm:Adding mgr.x on smithi187 2019-12-22T22:25:37.150 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator mgr update 2 smithi187=x 2019-12-22T22:25:39.380 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:25:40.380 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:25:43.256 INFO:teuthology.orchestra.run.smithi187.stdout:["(Re)deployed mgr.x on host 'smithi187'"] 2019-12-22T22:25:43.807 INFO:teuthology.orchestra.run.smithi187:mgr.x> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name mgr.x 2019-12-22T22:25:43.812 INFO:tasks.cephadm:Deploying OSDs... 2019-12-22T22:25:43.924 DEBUG:teuthology.orchestra.remote:smithi168:/scratch_devs is 72B 2019-12-22T22:25:44.003 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-22T22:25:44.004 INFO:teuthology.orchestra.run.smithi168:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-22T22:25:44.075 INFO:teuthology.orchestra.run.smithi168.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-22T22:25:44.075 INFO:teuthology.orchestra.run.smithi168.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:44.076 INFO:teuthology.orchestra.run.smithi168.stdout:Device: 5h/5d Inode: 108791 Links: 1 2019-12-22T22:25:44.076 INFO:teuthology.orchestra.run.smithi168.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:44.076 INFO:teuthology.orchestra.run.smithi168.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:44.076 INFO:teuthology.orchestra.run.smithi168.stdout:Access: 2019-12-22 22:25:07.333140155 +0000 2019-12-22T22:25:44.076 INFO:teuthology.orchestra.run.smithi168.stdout:Modify: 2019-12-22 22:19:23.265497425 +0000 2019-12-22T22:25:44.076 INFO:teuthology.orchestra.run.smithi168.stdout:Change: 2019-12-22 22:19:23.265497425 +0000 2019-12-22T22:25:44.076 INFO:teuthology.orchestra.run.smithi168.stdout: Birth: - 2019-12-22T22:25:44.107 INFO:teuthology.orchestra.run.smithi168.stderr:1+0 records in 2019-12-22T22:25:44.107 INFO:teuthology.orchestra.run.smithi168.stderr:1+0 records out 2019-12-22T22:25:44.107 INFO:teuthology.orchestra.run.smithi168.stderr:512 bytes (512 B) copied, 0.000328791 s, 1.6 MB/s 2019-12-22T22:25:44.111 INFO:teuthology.orchestra.run.smithi168:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-22T22:25:44.171 INFO:teuthology.orchestra.run.smithi168.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-22T22:25:44.172 INFO:teuthology.orchestra.run.smithi168.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:44.172 INFO:teuthology.orchestra.run.smithi168.stdout:Device: 5h/5d Inode: 107910 Links: 1 2019-12-22T22:25:44.172 INFO:teuthology.orchestra.run.smithi168.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:44.172 INFO:teuthology.orchestra.run.smithi168.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:44.172 INFO:teuthology.orchestra.run.smithi168.stdout:Access: 2019-12-22 22:25:07.333140155 +0000 2019-12-22T22:25:44.173 INFO:teuthology.orchestra.run.smithi168.stdout:Modify: 2019-12-22 22:19:23.757481582 +0000 2019-12-22T22:25:44.173 INFO:teuthology.orchestra.run.smithi168.stdout:Change: 2019-12-22 22:19:23.757481582 +0000 2019-12-22T22:25:44.173 INFO:teuthology.orchestra.run.smithi168.stdout: Birth: - 2019-12-22T22:25:44.189 INFO:teuthology.orchestra.run.smithi168.stderr:1+0 records in 2019-12-22T22:25:44.189 INFO:teuthology.orchestra.run.smithi168.stderr:1+0 records out 2019-12-22T22:25:44.190 INFO:teuthology.orchestra.run.smithi168.stderr:512 bytes (512 B) copied, 0.00029736 s, 1.7 MB/s 2019-12-22T22:25:44.192 INFO:teuthology.orchestra.run.smithi168:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-22T22:25:44.241 INFO:teuthology.orchestra.run.smithi168.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-22T22:25:44.241 INFO:teuthology.orchestra.run.smithi168.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:44.241 INFO:teuthology.orchestra.run.smithi168.stdout:Device: 5h/5d Inode: 104054 Links: 1 2019-12-22T22:25:44.241 INFO:teuthology.orchestra.run.smithi168.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:44.241 INFO:teuthology.orchestra.run.smithi168.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:44.242 INFO:teuthology.orchestra.run.smithi168.stdout:Access: 2019-12-22 22:25:07.333140155 +0000 2019-12-22T22:25:44.242 INFO:teuthology.orchestra.run.smithi168.stdout:Modify: 2019-12-22 22:19:24.258465449 +0000 2019-12-22T22:25:44.242 INFO:teuthology.orchestra.run.smithi168.stdout:Change: 2019-12-22 22:19:24.258465449 +0000 2019-12-22T22:25:44.242 INFO:teuthology.orchestra.run.smithi168.stdout: Birth: - 2019-12-22T22:25:44.254 INFO:teuthology.orchestra.run.smithi168.stderr:1+0 records in 2019-12-22T22:25:44.254 INFO:teuthology.orchestra.run.smithi168.stderr:1+0 records out 2019-12-22T22:25:44.254 INFO:teuthology.orchestra.run.smithi168.stderr:512 bytes (512 B) copied, 0.000295765 s, 1.7 MB/s 2019-12-22T22:25:44.257 INFO:teuthology.orchestra.run.smithi168:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-22T22:25:44.304 INFO:teuthology.orchestra.run.smithi168.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-22T22:25:44.305 INFO:teuthology.orchestra.run.smithi168.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:44.305 INFO:teuthology.orchestra.run.smithi168.stdout:Device: 5h/5d Inode: 104093 Links: 1 2019-12-22T22:25:44.305 INFO:teuthology.orchestra.run.smithi168.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:44.305 INFO:teuthology.orchestra.run.smithi168.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:44.305 INFO:teuthology.orchestra.run.smithi168.stdout:Access: 2019-12-22 22:25:07.333140155 +0000 2019-12-22T22:25:44.305 INFO:teuthology.orchestra.run.smithi168.stdout:Modify: 2019-12-22 22:19:24.761449251 +0000 2019-12-22T22:25:44.306 INFO:teuthology.orchestra.run.smithi168.stdout:Change: 2019-12-22 22:19:24.761449251 +0000 2019-12-22T22:25:44.306 INFO:teuthology.orchestra.run.smithi168.stdout: Birth: - 2019-12-22T22:25:44.319 INFO:teuthology.orchestra.run.smithi168.stderr:1+0 records in 2019-12-22T22:25:44.319 INFO:teuthology.orchestra.run.smithi168.stderr:1+0 records out 2019-12-22T22:25:44.319 INFO:teuthology.orchestra.run.smithi168.stderr:512 bytes (512 B) copied, 0.000317971 s, 1.6 MB/s 2019-12-22T22:25:44.437 DEBUG:teuthology.orchestra.remote:smithi071:/scratch_devs is 72B 2019-12-22T22:25:44.513 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-22T22:25:44.513 INFO:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-22T22:25:44.584 INFO:teuthology.orchestra.run.smithi071.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-22T22:25:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:44.585 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 107184 Links: 1 2019-12-22T22:25:44.585 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:44.585 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:44.585 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2019-12-22 22:22:53.669680760 +0000 2019-12-22T22:25:44.585 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2019-12-22 22:19:32.389550104 +0000 2019-12-22T22:25:44.586 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2019-12-22 22:19:32.389550104 +0000 2019-12-22T22:25:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2019-12-22T22:25:44.620 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2019-12-22T22:25:44.620 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2019-12-22T22:25:44.620 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes (512 B) copied, 0.000668158 s, 766 kB/s 2019-12-22T22:25:44.625 INFO:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-22T22:25:44.737 INFO:teuthology.orchestra.run.smithi071.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-22T22:25:44.737 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:44.737 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 104309 Links: 1 2019-12-22T22:25:44.737 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:44.738 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:44.738 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2019-12-22 22:22:53.669680760 +0000 2019-12-22T22:25:44.738 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2019-12-22 22:19:32.887541233 +0000 2019-12-22T22:25:44.738 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2019-12-22 22:19:32.887541233 +0000 2019-12-22T22:25:44.738 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2019-12-22T22:25:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2019-12-22T22:25:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2019-12-22T22:25:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes (512 B) copied, 0.000421719 s, 1.2 MB/s 2019-12-22T22:25:44.770 INFO:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-22T22:25:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-22T22:25:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:44.847 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 109698 Links: 1 2019-12-22T22:25:44.847 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:44.847 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:44.847 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2019-12-22 22:22:53.670680760 +0000 2019-12-22T22:25:44.847 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2019-12-22 22:19:33.365532717 +0000 2019-12-22T22:25:44.847 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2019-12-22 22:19:33.365532717 +0000 2019-12-22T22:25:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2019-12-22T22:25:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2019-12-22T22:25:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2019-12-22T22:25:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes (512 B) copied, 0.000461424 s, 1.1 MB/s 2019-12-22T22:25:44.877 INFO:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-22T22:25:44.942 INFO:teuthology.orchestra.run.smithi071.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-22T22:25:44.942 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:44.942 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 104386 Links: 1 2019-12-22T22:25:44.942 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:44.943 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:44.943 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2019-12-22 22:22:53.670680760 +0000 2019-12-22T22:25:44.943 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2019-12-22 22:19:33.831524416 +0000 2019-12-22T22:25:44.943 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2019-12-22 22:19:33.831524416 +0000 2019-12-22T22:25:44.943 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2019-12-22T22:25:44.962 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2019-12-22T22:25:44.962 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2019-12-22T22:25:44.962 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes (512 B) copied, 0.000328578 s, 1.6 MB/s 2019-12-22T22:25:45.101 DEBUG:teuthology.orchestra.remote:smithi187:/scratch_devs is 72B 2019-12-22T22:25:45.194 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-22T22:25:45.194 INFO:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-22T22:25:45.252 INFO:teuthology.orchestra.run.smithi187.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-22T22:25:45.253 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:45.253 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 97790 Links: 1 2019-12-22T22:25:45.253 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:45.253 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:45.254 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2019-12-22 22:25:42.488419502 +0000 2019-12-22T22:25:45.254 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2019-12-22 22:19:25.192830086 +0000 2019-12-22T22:25:45.254 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2019-12-22 22:19:25.192830086 +0000 2019-12-22T22:25:45.254 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2019-12-22T22:25:45.269 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2019-12-22T22:25:45.269 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2019-12-22T22:25:45.269 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes (512 B) copied, 0.000269993 s, 1.9 MB/s 2019-12-22T22:25:45.272 INFO:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-22T22:25:45.317 INFO:teuthology.orchestra.run.smithi187.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-22T22:25:45.317 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:45.318 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 97821 Links: 1 2019-12-22T22:25:45.318 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:45.318 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:45.318 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2019-12-22 22:25:42.488419502 +0000 2019-12-22T22:25:45.318 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2019-12-22 22:19:25.667824300 +0000 2019-12-22T22:25:45.318 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2019-12-22 22:19:25.667824300 +0000 2019-12-22T22:25:45.319 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2019-12-22T22:25:45.331 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2019-12-22T22:25:45.332 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2019-12-22T22:25:45.332 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes (512 B) copied, 0.000267306 s, 1.9 MB/s 2019-12-22T22:25:45.334 INFO:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-22T22:25:45.439 INFO:teuthology.orchestra.run.smithi187.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-22T22:25:45.439 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:45.440 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 106172 Links: 1 2019-12-22T22:25:45.440 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:45.440 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:45.440 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2019-12-22 22:25:42.489419494 +0000 2019-12-22T22:25:45.440 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2019-12-22 22:19:26.177818087 +0000 2019-12-22T22:25:45.440 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2019-12-22 22:19:26.177818087 +0000 2019-12-22T22:25:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2019-12-22T22:25:45.459 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2019-12-22T22:25:45.459 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2019-12-22T22:25:45.459 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes (512 B) copied, 0.000312129 s, 1.6 MB/s 2019-12-22T22:25:45.462 INFO:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-22T22:25:45.511 INFO:teuthology.orchestra.run.smithi187.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-22T22:25:45.511 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-22T22:25:45.511 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 106795 Links: 1 2019-12-22T22:25:45.511 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-22T22:25:45.511 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2019-12-22T22:25:45.511 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2019-12-22 22:25:42.489419494 +0000 2019-12-22T22:25:45.512 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2019-12-22 22:19:26.627812605 +0000 2019-12-22T22:25:45.512 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2019-12-22 22:19:26.627812605 +0000 2019-12-22T22:25:45.512 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2019-12-22T22:25:45.525 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2019-12-22T22:25:45.525 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2019-12-22T22:25:45.525 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes (512 B) copied, 0.000286763 s, 1.8 MB/s 2019-12-22T22:25:45.528 INFO:tasks.cephadm:Deploying osd.0 on smithi071 with /dev/vg_nvme/lv_1... 2019-12-22T22:25:45.528 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2019-12-22T22:25:47.749 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:25:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_1 2019-12-22T22:25:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2019-12-22T22:25:47.749 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2019-12-22T22:25:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2019-12-22T22:25:47.750 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0177405 s, 591 MB/s 2019-12-22T22:25:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2019-12-22T22:25:48.269 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi071:/dev/vg_nvme/lv_1 2019-12-22T22:25:50.650 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:25:58.155 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:26:01.658 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:26:04.431 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) on host 'smithi071' 2019-12-22T22:26:05.203 INFO:teuthology.orchestra.run.smithi071:osd.0> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.0 2019-12-22T22:26:05.208 INFO:tasks.cephadm:Deploying osd.1 on smithi071 with /dev/vg_nvme/lv_2... 2019-12-22T22:26:05.208 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2019-12-22T22:26:07.396 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:26:07.397 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_2 2019-12-22T22:26:07.397 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2019-12-22T22:26:07.397 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2019-12-22T22:26:07.397 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2019-12-22T22:26:07.397 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0141083 s, 743 MB/s 2019-12-22T22:26:07.398 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2019-12-22T22:26:07.921 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi071:/dev/vg_nvme/lv_2 2019-12-22T22:26:10.415 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:26:17.917 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:26:21.420 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:26:24.178 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) on host 'smithi071' 2019-12-22T22:26:24.948 INFO:teuthology.orchestra.run.smithi071:osd.1> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.1 2019-12-22T22:26:24.953 INFO:tasks.cephadm:Deploying osd.2 on smithi071 with /dev/vg_nvme/lv_3... 2019-12-22T22:26:24.954 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2019-12-22T22:26:25.272 INFO:ceph.osd.1.smithi071.stderr:Error: no container with name or ID ceph-7a4dd340-2509-11ea-8284-001a4aab830c-osd.1 found: no such container 2019-12-22T22:26:27.164 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:26:27.164 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_3 2019-12-22T22:26:27.164 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2019-12-22T22:26:27.164 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2019-12-22T22:26:27.164 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2019-12-22T22:26:27.164 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0177634 s, 590 MB/s 2019-12-22T22:26:27.165 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2019-12-22T22:26:27.759 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi071:/dev/vg_nvme/lv_3 2019-12-22T22:26:30.176 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:26:37.931 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:26:41.180 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:26:43.966 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) on host 'smithi071' 2019-12-22T22:26:44.855 INFO:teuthology.orchestra.run.smithi071:osd.2> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.2 2019-12-22T22:26:44.860 INFO:tasks.cephadm:Deploying osd.3 on smithi071 with /dev/vg_nvme/lv_4... 2019-12-22T22:26:44.860 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2019-12-22T22:26:45.371 INFO:ceph.osd.2.smithi071.stdout:2019-12-22T22:26:45.329+0000 7f37a19eeec0 1 -- 172.21.15.71:0/1714946692 >> v1:172.21.15.71:6789/0 conn(0x561b615f0400 legacy=0x561b615de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-22T22:26:45.869 INFO:ceph.osd.2.smithi071.stdout:2019-12-22T22:26:45.843+0000 7f37a19eeec0 -1 Falling back to public interface 2019-12-22T22:26:46.623 INFO:ceph.osd.2.smithi071.stdout:2019-12-22T22:26:46.403+0000 7f37a19eeec0 -1 osd.2 0 log_to_monitors {default=true} 2019-12-22T22:26:47.163 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:26:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping: /dev/vg_nvme/lv_4 2019-12-22T22:26:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2019-12-22T22:26:47.163 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10+0 records in 2019-12-22T22:26:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:10+0 records out 2019-12-22T22:26:47.164 INFO:teuthology.orchestra.run.smithi071.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.019598 s, 535 MB/s 2019-12-22T22:26:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:--> Zapping successful for: 2019-12-22T22:26:47.718 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi071:/dev/vg_nvme/lv_4 2019-12-22T22:26:48.122 INFO:ceph.osd.2.smithi071.stdout:2019-12-22T22:26:48.107+0000 7f378a796700 -1 osd.2 0 waiting for initial osdmap 2019-12-22T22:26:50.192 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:26:57.949 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:27:01.200 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi071,172.21.15.71' (ECDSA) to the list of known hosts. 2019-12-22T22:27:03.969 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) on host 'smithi071' 2019-12-22T22:27:04.859 INFO:teuthology.orchestra.run.smithi071:osd.3> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.3 2019-12-22T22:27:04.865 INFO:tasks.cephadm:Deploying osd.4 on smithi187 with /dev/vg_nvme/lv_1... 2019-12-22T22:27:04.865 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2019-12-22T22:27:05.405 INFO:ceph.osd.3.smithi071.stdout:2019-12-22T22:27:05.262+0000 7f94766f0ec0 1 -- 172.21.15.71:0/3120562506 >> v1:172.21.15.71:6789/0 conn(0x5644ca771b00 legacy=0x5644ca75f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-22T22:27:05.904 INFO:ceph.osd.3.smithi071.stdout:2019-12-22T22:27:05.774+0000 7f94766f0ec0 -1 Falling back to public interface 2019-12-22T22:27:06.404 INFO:ceph.osd.3.smithi071.stdout:2019-12-22T22:27:06.329+0000 7f94766f0ec0 -1 osd.3 0 log_to_monitors {default=true} 2019-12-22T22:27:07.045 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:27:07.045 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_1 2019-12-22T22:27:07.045 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2019-12-22T22:27:07.045 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2019-12-22T22:27:07.046 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2019-12-22T22:27:07.046 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.016256 s, 645 MB/s 2019-12-22T22:27:07.046 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2019-12-22T22:27:07.597 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi187:/dev/vg_nvme/lv_1 2019-12-22T22:27:08.155 INFO:ceph.osd.3.smithi071.stdout:2019-12-22T22:27:08.112+0000 7f945f498700 -1 osd.3 0 waiting for initial osdmap 2019-12-22T22:27:09.955 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:27:17.459 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:27:20.710 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:27:23.845 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) on host 'smithi187' 2019-12-22T22:27:24.686 INFO:teuthology.orchestra.run.smithi187:osd.4> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.4 2019-12-22T22:27:24.691 INFO:tasks.cephadm:Deploying osd.5 on smithi187 with /dev/vg_nvme/lv_2... 2019-12-22T22:27:24.691 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2019-12-22T22:27:25.078 INFO:ceph.osd.4.smithi187.stdout:2019-12-22T22:27:25.032+0000 7fe4e709cec0 1 -- 172.21.15.187:0/1108765931 >> v1:172.21.15.187:6789/0 conn(0x55fc4c765f80 legacy=0x55fc4c754000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-22T22:27:25.578 INFO:ceph.osd.4.smithi187.stdout:2019-12-22T22:27:25.542+0000 7fe4e709cec0 -1 Falling back to public interface 2019-12-22T22:27:26.328 INFO:ceph.osd.4.smithi187.stdout:2019-12-22T22:27:26.096+0000 7fe4e709cec0 -1 osd.4 0 log_to_monitors {default=true} 2019-12-22T22:27:27.068 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:27:27.069 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_2 2019-12-22T22:27:27.069 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2019-12-22T22:27:27.069 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2019-12-22T22:27:27.069 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2019-12-22T22:27:27.069 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0210762 s, 498 MB/s 2019-12-22T22:27:27.069 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2019-12-22T22:27:27.659 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi187:/dev/vg_nvme/lv_2 2019-12-22T22:27:28.329 INFO:ceph.osd.4.smithi187.stdout:2019-12-22T22:27:28.114+0000 7fe4cbe3c700 -1 osd.4 0 waiting for initial osdmap 2019-12-22T22:27:29.965 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:27:37.970 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:27:41.472 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:27:43.879 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) on host 'smithi187' 2019-12-22T22:27:44.546 INFO:teuthology.orchestra.run.smithi187:osd.5> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.5 2019-12-22T22:27:44.551 INFO:tasks.cephadm:Deploying osd.6 on smithi187 with /dev/vg_nvme/lv_3... 2019-12-22T22:27:44.551 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2019-12-22T22:27:44.892 INFO:ceph.osd.5.smithi187.stderr:Error: no container with name or ID ceph-7a4dd340-2509-11ea-8284-001a4aab830c-osd.5 found: no such container 2019-12-22T22:27:47.050 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:27:47.050 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_3 2019-12-22T22:27:47.051 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2019-12-22T22:27:47.051 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2019-12-22T22:27:47.051 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2019-12-22T22:27:47.051 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0191338 s, 548 MB/s 2019-12-22T22:27:47.051 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2019-12-22T22:27:47.604 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi187:/dev/vg_nvme/lv_3 2019-12-22T22:27:49.976 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:27:57.730 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:28:01.232 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:28:03.803 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) on host 'smithi187' 2019-12-22T22:28:04.396 INFO:teuthology.orchestra.run.smithi187:osd.6> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.6 2019-12-22T22:28:04.401 INFO:tasks.cephadm:Deploying osd.7 on smithi187 with /dev/vg_nvme/lv_4... 2019-12-22T22:28:04.401 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2019-12-22T22:28:04.712 INFO:ceph.osd.6.smithi187.stderr:Error: no container with name or ID ceph-7a4dd340-2509-11ea-8284-001a4aab830c-osd.6 found: no such container 2019-12-22T22:28:07.056 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:28:07.057 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_4 2019-12-22T22:28:07.057 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2019-12-22T22:28:07.057 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2019-12-22T22:28:07.057 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2019-12-22T22:28:07.057 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0187611 s, 559 MB/s 2019-12-22T22:28:07.057 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2019-12-22T22:28:07.643 INFO:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi187:/dev/vg_nvme/lv_4 2019-12-22T22:28:09.987 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:28:17.741 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:28:21.245 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi187,172.21.15.187' (ECDSA) to the list of known hosts. 2019-12-22T22:28:23.796 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) on host 'smithi187' 2019-12-22T22:28:24.636 INFO:teuthology.orchestra.run.smithi187:osd.7> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.7 2019-12-22T22:28:24.642 INFO:tasks.cephadm:Deploying osd.8 on smithi168 with /dev/vg_nvme/lv_1... 2019-12-22T22:28:24.642 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2019-12-22T22:28:24.995 INFO:ceph.osd.7.smithi187.stderr:Error: no container with name or ID ceph-7a4dd340-2509-11ea-8284-001a4aab830c-osd.7 found: no such container 2019-12-22T22:28:26.849 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:28:26.849 INFO:teuthology.orchestra.run.smithi168.stderr:--> Zapping: /dev/vg_nvme/lv_1 2019-12-22T22:28:26.849 INFO:teuthology.orchestra.run.smithi168.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2019-12-22T22:28:26.849 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: 10+0 records in 2019-12-22T22:28:26.849 INFO:teuthology.orchestra.run.smithi168.stderr:10+0 records out 2019-12-22T22:28:26.849 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.016504 s, 635 MB/s 2019-12-22T22:28:26.850 INFO:teuthology.orchestra.run.smithi168.stderr:--> Zapping successful for: 2019-12-22T22:28:27.382 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi168:/dev/vg_nvme/lv_1 2019-12-22T22:28:29.747 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:28:37.501 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:28:40.753 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:28:43.659 INFO:teuthology.orchestra.run.smithi168.stdout:Created osd(s) on host 'smithi168' 2019-12-22T22:28:44.386 INFO:teuthology.orchestra.run.smithi168:osd.8> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.8 2019-12-22T22:28:44.391 INFO:tasks.cephadm:Deploying osd.9 on smithi168 with /dev/vg_nvme/lv_2... 2019-12-22T22:28:44.392 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2019-12-22T22:28:45.519 INFO:ceph.osd.8.smithi168.stdout:2019-12-22T22:28:45.478+0000 7f8944edfec0 -1 Falling back to public interface 2019-12-22T22:28:46.270 INFO:ceph.osd.8.smithi168.stdout:2019-12-22T22:28:46.034+0000 7f8944edfec0 -1 osd.8 0 log_to_monitors {default=true} 2019-12-22T22:28:46.720 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:28:46.720 INFO:teuthology.orchestra.run.smithi168.stderr:--> Zapping: /dev/vg_nvme/lv_2 2019-12-22T22:28:46.720 INFO:teuthology.orchestra.run.smithi168.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2019-12-22T22:28:46.721 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: 10+0 records in 2019-12-22T22:28:46.721 INFO:teuthology.orchestra.run.smithi168.stderr:10+0 records out 2019-12-22T22:28:46.721 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0189159 s, 554 MB/s 2019-12-22T22:28:46.721 INFO:teuthology.orchestra.run.smithi168.stderr:--> Zapping successful for: 2019-12-22T22:28:47.269 INFO:ceph.osd.8.smithi168.stdout:2019-12-22T22:28:47.122+0000 7f8929c7f700 -1 osd.8 0 waiting for initial osdmap 2019-12-22T22:28:47.316 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi168:/dev/vg_nvme/lv_2 2019-12-22T22:28:49.758 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:28:57.512 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:29:00.515 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:29:03.499 INFO:teuthology.orchestra.run.smithi168.stdout:Created osd(s) on host 'smithi168' 2019-12-22T22:29:04.331 INFO:teuthology.orchestra.run.smithi168:osd.9> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.9 2019-12-22T22:29:04.336 INFO:tasks.cephadm:Deploying osd.10 on smithi168 with /dev/vg_nvme/lv_3... 2019-12-22T22:29:04.336 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2019-12-22T22:29:05.275 INFO:ceph.osd.9.smithi168.stdout:2019-12-22T22:29:05.267+0000 7fe017128ec0 -1 Falling back to public interface 2019-12-22T22:29:06.025 INFO:ceph.osd.9.smithi168.stdout:2019-12-22T22:29:05.825+0000 7fe017128ec0 -1 osd.9 0 log_to_monitors {default=true} 2019-12-22T22:29:06.599 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:29:06.599 INFO:teuthology.orchestra.run.smithi168.stderr:--> Zapping: /dev/vg_nvme/lv_3 2019-12-22T22:29:06.599 INFO:teuthology.orchestra.run.smithi168.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2019-12-22T22:29:06.599 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: 10+0 records in 2019-12-22T22:29:06.599 INFO:teuthology.orchestra.run.smithi168.stderr:10+0 records out 2019-12-22T22:29:06.600 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0156267 s, 671 MB/s 2019-12-22T22:29:06.600 INFO:teuthology.orchestra.run.smithi168.stderr:--> Zapping successful for: 2019-12-22T22:29:07.026 INFO:ceph.osd.9.smithi168.stdout:2019-12-22T22:29:06.913+0000 7fdfffed0700 -1 osd.9 0 waiting for initial osdmap 2019-12-22T22:29:07.223 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi168:/dev/vg_nvme/lv_3 2019-12-22T22:29:09.518 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:29:17.274 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:29:20.524 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:29:23.404 INFO:teuthology.orchestra.run.smithi168.stdout:Created osd(s) on host 'smithi168' 2019-12-22T22:29:24.213 INFO:teuthology.orchestra.run.smithi168:osd.10> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.10 2019-12-22T22:29:24.218 INFO:tasks.cephadm:Deploying osd.11 on smithi168 with /dev/vg_nvme/lv_4... 2019-12-22T22:29:24.218 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2019-12-22T22:29:24.742 INFO:ceph.osd.10.smithi168.stdout:2019-12-22T22:29:24.591+0000 7f842f81cec0 1 -- 172.21.15.168:0/377612942 >> v1:172.21.15.168:6789/0 conn(0x563cad22fb00 legacy=0x563cad21d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-22T22:29:25.242 INFO:ceph.osd.10.smithi168.stdout:2019-12-22T22:29:25.101+0000 7f842f81cec0 -1 Falling back to public interface 2019-12-22T22:29:25.741 INFO:ceph.osd.10.smithi168.stdout:2019-12-22T22:29:25.644+0000 7f842f81cec0 -1 osd.10 0 log_to_monitors {default=true} 2019-12-22T22:29:26.422 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: /usr/sbin/udevadm: error while loading shared libraries: libsystemd-shared-239.so: cannot open shared object file: No such file or directory 2019-12-22T22:29:26.422 INFO:teuthology.orchestra.run.smithi168.stderr:--> Zapping: /dev/vg_nvme/lv_4 2019-12-22T22:29:26.422 INFO:teuthology.orchestra.run.smithi168.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2019-12-22T22:29:26.422 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: 10+0 records in 2019-12-22T22:29:26.423 INFO:teuthology.orchestra.run.smithi168.stderr:10+0 records out 2019-12-22T22:29:26.423 INFO:teuthology.orchestra.run.smithi168.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0162864 s, 644 MB/s 2019-12-22T22:29:26.423 INFO:teuthology.orchestra.run.smithi168.stderr:--> Zapping successful for: 2019-12-22T22:29:26.994 INFO:ceph.osd.10.smithi168.stdout:2019-12-22T22:29:26.910+0000 7f84145bc700 -1 osd.10 0 waiting for initial osdmap 2019-12-22T22:29:27.020 INFO:teuthology.orchestra.run.smithi168:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph orchestrator osd create smithi168:/dev/vg_nvme/lv_4 2019-12-22T22:29:29.529 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:29:37.283 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:29:40.534 INFO:ceph.mgr.y.smithi071.stdout:Warning: Permanently added 'smithi168,172.21.15.168' (ECDSA) to the list of known hosts. 2019-12-22T22:29:43.258 INFO:teuthology.orchestra.run.smithi168.stdout:Created osd(s) on host 'smithi168' 2019-12-22T22:29:43.981 INFO:teuthology.orchestra.run.smithi168:osd.11> sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a4dd340-2509-11ea-8284-001a4aab830c --name osd.11 2019-12-22T22:29:43.988 INFO:tasks.cephadm:Distributing config and client.admin keyring... 2019-12-22T22:29:43.988 INFO:teuthology.orchestra.run.smithi168:> sudo mkdir -p /etc/ceph 2019-12-22T22:29:44.126 INFO:teuthology.orchestra.run.smithi168:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2019-12-22T22:29:44.197 INFO:teuthology.orchestra.run.smithi168:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2019-12-22T22:29:44.314 INFO:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2019-12-22T22:29:44.441 INFO:ceph.osd.11.smithi168.stderr:Error: no container with name or ID ceph-7a4dd340-2509-11ea-8284-001a4aab830c-osd.11 found: no such container 2019-12-22T22:29:44.499 INFO:teuthology.orchestra.run.smithi071:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2019-12-22T22:29:44.614 INFO:teuthology.orchestra.run.smithi071:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2019-12-22T22:29:44.703 INFO:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph 2019-12-22T22:29:44.872 INFO:teuthology.orchestra.run.smithi187:> sudo sh -c 'cat > /etc/ceph/ceph.conf' 2019-12-22T22:29:44.974 INFO:teuthology.orchestra.run.smithi187:> sudo sh -c 'cat > /etc/ceph/ceph.client.admin.keyring' 2019-12-22T22:29:45.054 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd dump --format=json 2019-12-22T22:29:47.289 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:29:47.290 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":63,"fsid":"7a4dd340-2509-11ea-8284-001a4aab830c","created":"2019-12-22T22:22:48.676390+0000","modified":"2019-12-22T22:29:47.098872+0000","last_up_change":"2019-12-22T22:29:27.903377+0000","last_in_change":"2019-12-22T22:29:27.903377+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"86ddcd9d-c925-411c-9d2e-7d613821a309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6802","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6804","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6803","nonce":1}]},"public_addr":"172.21.15.71:6801/1","cluster_addr":"172.21.15.71:6802/1","heartbeat_back_addr":"172.21.15.71:6804/1","heartbeat_front_addr":"172.21.15.71:6803/1","state":["exists","up"]},{"osd":1,"uuid":"e04a3b24-9682-45c0-941e-864c366073d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6805","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6806","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6808","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6807","nonce":1}]},"public_addr":"172.21.15.71:6805/1","cluster_addr":"172.21.15.71:6806/1","heartbeat_back_addr":"172.21.15.71:6808/1","heartbeat_front_addr":"172.21.15.71:6807/1","state":["exists","up"]},{"osd":2,"uuid":"0595079d-cd61-4a72-b8bf-44eb0a1ef481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6810","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6812","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6811","nonce":1}]},"public_addr":"172.21.15.71:6809/1","cluster_addr":"172.21.15.71:6810/1","heartbeat_back_addr":"172.21.15.71:6812/1","heartbeat_front_addr":"172.21.15.71:6811/1","state":["exists","up"]},{"osd":3,"uuid":"fa5d9344-8667-46dd-93a7-a0684738d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6813","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6814","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6816","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6815","nonce":1}]},"public_addr":"172.21.15.71:6813/1","cluster_addr":"172.21.15.71:6814/1","heartbeat_back_addr":"172.21.15.71:6816/1","heartbeat_front_addr":"172.21.15.71:6815/1","state":["exists","up"]},{"osd":4,"uuid":"9c910c75-dedc-4b7d-8f81-ba004d95a266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6800","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6801","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6803","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6802","nonce":1}]},"public_addr":"172.21.15.187:6800/1","cluster_addr":"172.21.15.187:6801/1","heartbeat_back_addr":"172.21.15.187:6803/1","heartbeat_front_addr":"172.21.15.187:6802/1","state":["exists","up"]},{"osd":5,"uuid":"f9702fa9-8a09-43bc-b759-3a4dfd381551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6804","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6806","nonce":1}]},"public_addr":"172.21.15.187:6804/1","cluster_addr":"172.21.15.187:6805/1","heartbeat_back_addr":"172.21.15.187:6807/1","heartbeat_front_addr":"172.21.15.187:6806/1","state":["exists","up"]},{"osd":6,"uuid":"5fb32f24-707e-4b7c-8ed6-b5b44ec0903b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6808","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6809","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6811","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6810","nonce":1}]},"public_addr":"172.21.15.187:6808/1","cluster_addr":"172.21.15.187:6809/1","heartbeat_back_addr":"172.21.15.187:6811/1","heartbeat_front_addr":"172.21.15.187:6810/1","state":["exists","up"]},{"osd":7,"uuid":"2da96598-0a1b-4efa-84df-d856fdcef32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6812","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6814","nonce":1}]},"public_addr":"172.21.15.187:6812/1","cluster_addr":"172.21.15.187:6813/1","heartbeat_back_addr":"172.21.15.187:6815/1","heartbeat_front_addr":"172.21.15.187:6814/1","state":["exists","up"]},{"osd":8,"uuid":"4452d1c7-9eda-4248-ab44-0e4004193942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6800","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6801","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6803","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6802","nonce":1}]},"public_addr":"172.21.15.168:6800/1","cluster_addr":"172.21.15.168:6801/1","heartbeat_back_addr":"172.21.15.168:6803/1","heartbeat_front_addr":"172.21.15.168:6802/1","state":["exists","up"]},{"osd":9,"uuid":"1c07ce0a-aaec-4aba-914e-9c6c940f5467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6804","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6806","nonce":1}]},"public_addr":"172.21.15.168:6804/1","cluster_addr":"172.21.15.168:6805/1","heartbeat_back_addr":"172.21.15.168:6807/1","heartbeat_front_addr":"172.21.15.168:6806/1","state":["exists","up"]},{"osd":10,"uuid":"3734f370-31a4-43a2-9c3b-0a10280ac4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6808","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6809","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6811","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6810","nonce":1}]},"public_addr":"172.21.15.168:6808/1","cluster_addr":"172.21.15.168:6809/1","heartbeat_back_addr":"172.21.15.168:6811/1","heartbeat_front_addr":"172.21.15.168:6810/1","state":["exists","up"]},{"osd":11,"uuid":"a0f20104-717f-4c4f-a79e-3a217b371eae","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:09.982629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:29.239820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:28:48.999624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:08.246843+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:29.065472+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:28:48.329729+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:07.734695+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:27.592229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:28:47.032412+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:06.779401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:26.636720+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.71:6800/1":"2019-12-23T22:23:05.056165+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-22T22:29:47.919 INFO:tasks.cephadm.ceph_manager.ceph:[] 2019-12-22T22:29:47.919 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-12-22T22:29:47.919 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2019-12-22T22:29:47.920 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph mgr dump --format=json 2019-12-22T22:29:50.095 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:29:50.630 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":11,"active_gid":14121,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6800","nonce":1}]},"active_addr":"172.21.15.71:6800/1","active_change":"2019-12-22T22:23:31.945030+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34103,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi071.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[]}} 2019-12-22T22:29:50.639 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2019-12-22T22:29:50.640 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2019-12-22T22:29:50.640 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd dump --format=json 2019-12-22T22:29:52.844 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:29:52.844 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"fsid":"7a4dd340-2509-11ea-8284-001a4aab830c","created":"2019-12-22T22:22:48.676390+0000","modified":"2019-12-22T22:29:50.128515+0000","last_up_change":"2019-12-22T22:29:48.110058+0000","last_in_change":"2019-12-22T22:29:48.110058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"86ddcd9d-c925-411c-9d2e-7d613821a309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6802","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6804","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6803","nonce":1}]},"public_addr":"172.21.15.71:6801/1","cluster_addr":"172.21.15.71:6802/1","heartbeat_back_addr":"172.21.15.71:6804/1","heartbeat_front_addr":"172.21.15.71:6803/1","state":["exists","up"]},{"osd":1,"uuid":"e04a3b24-9682-45c0-941e-864c366073d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6805","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6806","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6808","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6807","nonce":1}]},"public_addr":"172.21.15.71:6805/1","cluster_addr":"172.21.15.71:6806/1","heartbeat_back_addr":"172.21.15.71:6808/1","heartbeat_front_addr":"172.21.15.71:6807/1","state":["exists","up"]},{"osd":2,"uuid":"0595079d-cd61-4a72-b8bf-44eb0a1ef481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6810","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6812","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6811","nonce":1}]},"public_addr":"172.21.15.71:6809/1","cluster_addr":"172.21.15.71:6810/1","heartbeat_back_addr":"172.21.15.71:6812/1","heartbeat_front_addr":"172.21.15.71:6811/1","state":["exists","up"]},{"osd":3,"uuid":"fa5d9344-8667-46dd-93a7-a0684738d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6813","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6814","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6816","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6815","nonce":1}]},"public_addr":"172.21.15.71:6813/1","cluster_addr":"172.21.15.71:6814/1","heartbeat_back_addr":"172.21.15.71:6816/1","heartbeat_front_addr":"172.21.15.71:6815/1","state":["exists","up"]},{"osd":4,"uuid":"9c910c75-dedc-4b7d-8f81-ba004d95a266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6800","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6801","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6803","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6802","nonce":1}]},"public_addr":"172.21.15.187:6800/1","cluster_addr":"172.21.15.187:6801/1","heartbeat_back_addr":"172.21.15.187:6803/1","heartbeat_front_addr":"172.21.15.187:6802/1","state":["exists","up"]},{"osd":5,"uuid":"f9702fa9-8a09-43bc-b759-3a4dfd381551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6804","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6806","nonce":1}]},"public_addr":"172.21.15.187:6804/1","cluster_addr":"172.21.15.187:6805/1","heartbeat_back_addr":"172.21.15.187:6807/1","heartbeat_front_addr":"172.21.15.187:6806/1","state":["exists","up"]},{"osd":6,"uuid":"5fb32f24-707e-4b7c-8ed6-b5b44ec0903b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6808","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6809","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6811","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6810","nonce":1}]},"public_addr":"172.21.15.187:6808/1","cluster_addr":"172.21.15.187:6809/1","heartbeat_back_addr":"172.21.15.187:6811/1","heartbeat_front_addr":"172.21.15.187:6810/1","state":["exists","up"]},{"osd":7,"uuid":"2da96598-0a1b-4efa-84df-d856fdcef32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6812","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6814","nonce":1}]},"public_addr":"172.21.15.187:6812/1","cluster_addr":"172.21.15.187:6813/1","heartbeat_back_addr":"172.21.15.187:6815/1","heartbeat_front_addr":"172.21.15.187:6814/1","state":["exists","up"]},{"osd":8,"uuid":"4452d1c7-9eda-4248-ab44-0e4004193942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6800","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6801","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6803","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6802","nonce":1}]},"public_addr":"172.21.15.168:6800/1","cluster_addr":"172.21.15.168:6801/1","heartbeat_back_addr":"172.21.15.168:6803/1","heartbeat_front_addr":"172.21.15.168:6802/1","state":["exists","up"]},{"osd":9,"uuid":"1c07ce0a-aaec-4aba-914e-9c6c940f5467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6804","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6806","nonce":1}]},"public_addr":"172.21.15.168:6804/1","cluster_addr":"172.21.15.168:6805/1","heartbeat_back_addr":"172.21.15.168:6807/1","heartbeat_front_addr":"172.21.15.168:6806/1","state":["exists","up"]},{"osd":10,"uuid":"3734f370-31a4-43a2-9c3b-0a10280ac4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6808","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6809","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6811","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6810","nonce":1}]},"public_addr":"172.21.15.168:6808/1","cluster_addr":"172.21.15.168:6809/1","heartbeat_back_addr":"172.21.15.168:6811/1","heartbeat_front_addr":"172.21.15.168:6810/1","state":["exists","up"]},{"osd":11,"uuid":"a0f20104-717f-4c4f-a79e-3a217b371eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6812","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6814","nonce":1}]},"public_addr":"172.21.15.168:6812/1","cluster_addr":"172.21.15.168:6813/1","heartbeat_back_addr":"172.21.15.168:6815/1","heartbeat_front_addr":"172.21.15.168:6814/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:09.982629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:29.239820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:49.845208+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:08.246843+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:29.065472+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:48.457582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:07.734695+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:27.592229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:47.836268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:06.779401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:26.636720+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:47.048895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.71:6800/1":"2019-12-23T22:23:05.056165+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-22T22:29:53.447 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2019-12-22T22:29:53.447 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd dump --format=json 2019-12-22T22:29:55.609 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:29:55.609 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"fsid":"7a4dd340-2509-11ea-8284-001a4aab830c","created":"2019-12-22T22:22:48.676390+0000","modified":"2019-12-22T22:29:50.128515+0000","last_up_change":"2019-12-22T22:29:48.110058+0000","last_in_change":"2019-12-22T22:29:48.110058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":25,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"86ddcd9d-c925-411c-9d2e-7d613821a309","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6801","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6802","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6804","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6803","nonce":1}]},"public_addr":"172.21.15.71:6801/1","cluster_addr":"172.21.15.71:6802/1","heartbeat_back_addr":"172.21.15.71:6804/1","heartbeat_front_addr":"172.21.15.71:6803/1","state":["exists","up"]},{"osd":1,"uuid":"e04a3b24-9682-45c0-941e-864c366073d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6805","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6806","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6808","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6807","nonce":1}]},"public_addr":"172.21.15.71:6805/1","cluster_addr":"172.21.15.71:6806/1","heartbeat_back_addr":"172.21.15.71:6808/1","heartbeat_front_addr":"172.21.15.71:6807/1","state":["exists","up"]},{"osd":2,"uuid":"0595079d-cd61-4a72-b8bf-44eb0a1ef481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6809","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6810","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6812","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6811","nonce":1}]},"public_addr":"172.21.15.71:6809/1","cluster_addr":"172.21.15.71:6810/1","heartbeat_back_addr":"172.21.15.71:6812/1","heartbeat_front_addr":"172.21.15.71:6811/1","state":["exists","up"]},{"osd":3,"uuid":"fa5d9344-8667-46dd-93a7-a0684738d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6813","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6814","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6816","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.71:6815","nonce":1}]},"public_addr":"172.21.15.71:6813/1","cluster_addr":"172.21.15.71:6814/1","heartbeat_back_addr":"172.21.15.71:6816/1","heartbeat_front_addr":"172.21.15.71:6815/1","state":["exists","up"]},{"osd":4,"uuid":"9c910c75-dedc-4b7d-8f81-ba004d95a266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6800","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6801","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6803","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6802","nonce":1}]},"public_addr":"172.21.15.187:6800/1","cluster_addr":"172.21.15.187:6801/1","heartbeat_back_addr":"172.21.15.187:6803/1","heartbeat_front_addr":"172.21.15.187:6802/1","state":["exists","up"]},{"osd":5,"uuid":"f9702fa9-8a09-43bc-b759-3a4dfd381551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6804","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6806","nonce":1}]},"public_addr":"172.21.15.187:6804/1","cluster_addr":"172.21.15.187:6805/1","heartbeat_back_addr":"172.21.15.187:6807/1","heartbeat_front_addr":"172.21.15.187:6806/1","state":["exists","up"]},{"osd":6,"uuid":"5fb32f24-707e-4b7c-8ed6-b5b44ec0903b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6808","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6809","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6811","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6810","nonce":1}]},"public_addr":"172.21.15.187:6808/1","cluster_addr":"172.21.15.187:6809/1","heartbeat_back_addr":"172.21.15.187:6811/1","heartbeat_front_addr":"172.21.15.187:6810/1","state":["exists","up"]},{"osd":7,"uuid":"2da96598-0a1b-4efa-84df-d856fdcef32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6812","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.187:6814","nonce":1}]},"public_addr":"172.21.15.187:6812/1","cluster_addr":"172.21.15.187:6813/1","heartbeat_back_addr":"172.21.15.187:6815/1","heartbeat_front_addr":"172.21.15.187:6814/1","state":["exists","up"]},{"osd":8,"uuid":"4452d1c7-9eda-4248-ab44-0e4004193942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6800","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6801","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6803","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6802","nonce":1}]},"public_addr":"172.21.15.168:6800/1","cluster_addr":"172.21.15.168:6801/1","heartbeat_back_addr":"172.21.15.168:6803/1","heartbeat_front_addr":"172.21.15.168:6802/1","state":["exists","up"]},{"osd":9,"uuid":"1c07ce0a-aaec-4aba-914e-9c6c940f5467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6804","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6805","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6807","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6806","nonce":1}]},"public_addr":"172.21.15.168:6804/1","cluster_addr":"172.21.15.168:6805/1","heartbeat_back_addr":"172.21.15.168:6807/1","heartbeat_front_addr":"172.21.15.168:6806/1","state":["exists","up"]},{"osd":10,"uuid":"3734f370-31a4-43a2-9c3b-0a10280ac4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6808","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6809","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6811","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6810","nonce":1}]},"public_addr":"172.21.15.168:6808/1","cluster_addr":"172.21.15.168:6809/1","heartbeat_back_addr":"172.21.15.168:6811/1","heartbeat_front_addr":"172.21.15.168:6810/1","state":["exists","up"]},{"osd":11,"uuid":"a0f20104-717f-4c4f-a79e-3a217b371eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6812","nonce":1}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6813","nonce":1}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6815","nonce":1}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.168:6814","nonce":1}]},"public_addr":"172.21.15.168:6812/1","cluster_addr":"172.21.15.168:6813/1","heartbeat_back_addr":"172.21.15.168:6815/1","heartbeat_front_addr":"172.21.15.168:6814/1","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:09.982629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:29.239820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:49.845208+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:08.246843+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:29.065472+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:48.457582+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:07.734695+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:27.592229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:47.836268+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:06.779401+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:26.636720+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-22T22:29:47.048895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.71:6800/1":"2019-12-23T22:23:05.056165+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-22T22:29:56.134 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2019-12-22T22:29:58.760 INFO:teuthology.orchestra.run.smithi071.stdout:30064771121 2019-12-22T22:29:58.761 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2019-12-22T22:30:01.437 INFO:teuthology.orchestra.run.smithi071.stdout:51539607597 2019-12-22T22:30:01.437 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2019-12-22T22:30:04.226 INFO:teuthology.orchestra.run.smithi071.stdout:73014444072 2019-12-22T22:30:04.227 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2019-12-22T22:30:06.881 INFO:teuthology.orchestra.run.smithi071.stdout:94489280551 2019-12-22T22:30:06.881 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2019-12-22T22:30:10.208 INFO:teuthology.orchestra.run.smithi071.stdout:115964117025 2019-12-22T22:30:10.209 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2019-12-22T22:30:13.556 INFO:teuthology.orchestra.run.smithi071.stdout:137438953503 2019-12-22T22:30:13.556 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2019-12-22T22:30:16.217 INFO:teuthology.orchestra.run.smithi071.stdout:158913789980 2019-12-22T22:30:16.218 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2019-12-22T22:30:19.591 INFO:teuthology.orchestra.run.smithi071.stdout:180388626457 2019-12-22T22:30:19.591 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2019-12-22T22:30:22.192 INFO:teuthology.orchestra.run.smithi071.stdout:201863462934 2019-12-22T22:30:22.192 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2019-12-22T22:30:25.523 INFO:teuthology.orchestra.run.smithi071.stdout:223338299410 2019-12-22T22:30:25.524 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2019-12-22T22:30:28.956 INFO:teuthology.orchestra.run.smithi071.stdout:249108103182 2019-12-22T22:30:28.957 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2019-12-22T22:30:31.609 INFO:teuthology.orchestra.run.smithi071.stdout:274877906955 2019-12-22T22:30:31.610 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.0 2019-12-22T22:30:33.794 INFO:teuthology.orchestra.run.smithi071.stdout:30064771128 2019-12-22T22:30:34.397 INFO:tasks.cephadm.ceph_manager.ceph:need seq 30064771121 got 30064771128 for osd.0 2019-12-22T22:30:34.397 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.1 2019-12-22T22:30:36.696 INFO:teuthology.orchestra.run.smithi071.stdout:51539607603 2019-12-22T22:30:37.286 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607597 got 51539607603 for osd.1 2019-12-22T22:30:37.287 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.2 2019-12-22T22:30:39.489 INFO:teuthology.orchestra.run.smithi071.stdout:73014444079 2019-12-22T22:30:40.028 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444072 got 73014444079 for osd.2 2019-12-22T22:30:40.029 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.3 2019-12-22T22:30:42.120 INFO:teuthology.orchestra.run.smithi071.stdout:94489280557 2019-12-22T22:30:42.756 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280551 got 94489280557 for osd.3 2019-12-22T22:30:42.756 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.4 2019-12-22T22:30:44.928 INFO:teuthology.orchestra.run.smithi071.stdout:115964117032 2019-12-22T22:30:45.523 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117025 got 115964117032 for osd.4 2019-12-22T22:30:45.523 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.5 2019-12-22T22:30:47.731 INFO:teuthology.orchestra.run.smithi071.stdout:137438953510 2019-12-22T22:30:48.340 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953503 got 137438953510 for osd.5 2019-12-22T22:30:48.340 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.6 2019-12-22T22:30:50.562 INFO:teuthology.orchestra.run.smithi071.stdout:158913789986 2019-12-22T22:30:51.142 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789980 got 158913789986 for osd.6 2019-12-22T22:30:51.142 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.7 2019-12-22T22:30:53.341 INFO:teuthology.orchestra.run.smithi071.stdout:180388626464 2019-12-22T22:30:53.883 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626457 got 180388626464 for osd.7 2019-12-22T22:30:53.884 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.8 2019-12-22T22:30:56.008 INFO:teuthology.orchestra.run.smithi071.stdout:201863462940 2019-12-22T22:30:56.583 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462934 got 201863462940 for osd.8 2019-12-22T22:30:56.583 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.9 2019-12-22T22:30:58.664 INFO:teuthology.orchestra.run.smithi071.stdout:223338299416 2019-12-22T22:30:59.245 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299410 got 223338299416 for osd.9 2019-12-22T22:30:59.245 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.10 2019-12-22T22:31:01.386 INFO:teuthology.orchestra.run.smithi071.stdout:249108103189 2019-12-22T22:31:02.012 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103182 got 249108103189 for osd.10 2019-12-22T22:31:02.012 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd last-stat-seq osd.11 2019-12-22T22:31:04.171 INFO:teuthology.orchestra.run.smithi071.stdout:274877906961 2019-12-22T22:31:04.745 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906955 got 274877906961 for osd.11 2019-12-22T22:31:04.745 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2019-12-22T22:31:04.745 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph pg dump --format=json 2019-12-22T22:31:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:31:06.936 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2019-12-22T22:31:07.512 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2019-12-22T22:31:06.081577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124941824,"kb_used":12589824,"kb_used_data":6288,"kb_used_omap":0,"kb_used_meta":12582912,"kb_avail":1112352000,"statfs":{"total":1151940427776,"available":1139048448000,"internally_reserved":12884901888,"allocated":6438912,"data_stored":2780328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12884901888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":15.516,"5min":15.516,"15min":15.516},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":294.724,"5min":294.724,"15min":294.724},"last":1.500},{"interface":"front","average":{"1min":29.217,"5min":29.217,"15min":29.217},"min":{"1min":0.681,"5min":0.681,"15min":0.681},"max":{"1min":567.422,"5min":567.422,"15min":567.422},"last":1.621}]},{"osd":1,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":0.957,"5min":0.957,"15min":0.957},"min":{"1min":0.610,"5min":0.610,"15min":0.610},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.587},{"interface":"front","average":{"1min":46.470,"5min":46.470,"15min":46.470},"min":{"1min":0.854,"5min":0.854,"15min":0.854},"max":{"1min":899.728,"5min":899.728,"15min":899.728},"last":1.719}]},{"osd":2,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":0.946,"5min":0.946,"15min":0.946},"min":{"1min":0.607,"5min":0.607,"15min":0.607},"max":{"1min":1.493,"5min":1.493,"15min":1.493},"last":1.526},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.685,"5min":0.685,"15min":0.685},"max":{"1min":1.529,"5min":1.529,"15min":1.529},"last":1.466}]},{"osd":3,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.168,"5min":1.168,"15min":1.168},"min":{"1min":0.813,"5min":0.813,"15min":0.813},"max":{"1min":1.850,"5min":1.850,"15min":1.850},"last":1.385},{"interface":"front","average":{"1min":1.729,"5min":1.729,"15min":1.729},"min":{"1min":0.880,"5min":0.880,"15min":0.880},"max":{"1min":11.220,"5min":11.220,"15min":11.220},"last":1.673}]},{"osd":4,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.783,"5min":1.783,"15min":1.783},"min":{"1min":1.001,"5min":1.001,"15min":1.001},"max":{"1min":11.106,"5min":11.106,"15min":11.106},"last":0.896},{"interface":"front","average":{"1min":1.313,"5min":1.313,"15min":1.313},"min":{"1min":0.939,"5min":0.939,"15min":0.939},"max":{"1min":1.689,"5min":1.689,"15min":1.689},"last":0.705}]},{"osd":5,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.396,"5min":1.396,"15min":1.396},"min":{"1min":1.167,"5min":1.167,"15min":1.167},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.251},{"interface":"front","average":{"1min":1.983,"5min":1.983,"15min":1.983},"min":{"1min":1.208,"5min":1.208,"15min":1.208},"max":{"1min":11.156,"5min":11.156,"15min":11.156},"last":1.222}]},{"osd":6,"last update":"Sun Dec 22 22:30:48 2019","interfaces":[{"interface":"back","average":{"1min":53.038,"5min":53.038,"15min":53.038},"min":{"1min":0.972,"5min":0.972,"15min":0.972},"max":{"1min":502.058,"5min":502.058,"15min":502.058},"last":1.107},{"interface":"front","average":{"1min":27.795,"5min":27.795,"15min":27.795},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":501.852,"5min":501.852,"15min":501.852},"last":1.163}]},{"osd":7,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.128,"5min":2.128,"15min":2.128},"last":1.303},{"interface":"front","average":{"1min":25.185,"5min":25.185,"15min":25.185},"min":{"1min":1.312,"5min":1.312,"15min":1.312},"max":{"1min":473.675,"5min":473.675,"15min":473.675},"last":0.969}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":37.192,"5min":37.192,"15min":37.192},"min":{"1min":1.274,"5min":1.274,"15min":1.274},"max":{"1min":502.226,"5min":502.226,"15min":502.226},"last":0.804},{"interface":"front","average":{"1min":1.682,"5min":1.682,"15min":1.682},"min":{"1min":1.399,"5min":1.399,"15min":1.399},"max":{"1min":2.170,"5min":2.170,"15min":2.170},"last":1.047}]},{"osd":10,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":2.178,"5min":2.178,"15min":2.178},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":11.281,"5min":11.281,"15min":11.281},"last":1.354},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.292,"5min":1.292,"15min":1.292},"max":{"1min":2.271,"5min":2.271,"15min":2.271},"last":1.409}]}]},{"osd":10,"up_from":58,"seq":249108103190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.608}]},{"osd":1,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.932,"5min":0.932,"15min":0.932},"min":{"1min":0.632,"5min":0.632,"15min":0.632},"max":{"1min":1.400,"5min":1.400,"15min":1.400},"last":0.916},{"interface":"front","average":{"1min":1.049,"5min":1.049,"15min":1.049},"min":{"1min":0.702,"5min":0.702,"15min":0.702},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.402}]},{"osd":2,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.994,"5min":0.994,"15min":0.994},"min":{"1min":0.729,"5min":0.729,"15min":0.729},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.311},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.790,"5min":0.790,"15min":0.790},"max":{"1min":1.710,"5min":1.710,"15min":1.710},"last":1.086}]},{"osd":3,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.927,"5min":0.927,"15min":0.927},"min":{"1min":0.678,"5min":0.678,"15min":0.678},"max":{"1min":1.574,"5min":1.574,"15min":1.574},"last":0.846},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.639,"5min":0.639,"15min":0.639},"max":{"1min":1.497,"5min":1.497,"15min":1.497},"last":1.030}]},{"osd":4,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.732,"5min":0.732,"15min":0.732},"max":{"1min":1.811,"5min":1.811,"15min":1.811},"last":1.201},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.540,"5min":1.540,"15min":1.540},"last":1.480}]},{"osd":5,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.515,"5min":1.515,"15min":1.515},"min":{"1min":0.902,"5min":0.902,"15min":0.902},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.275},{"interface":"front","average":{"1min":1.291,"5min":1.291,"15min":1.291},"min":{"1min":0.794,"5min":0.794,"15min":0.794},"max":{"1min":1.981,"5min":1.981,"15min":1.981},"last":1.516}]},{"osd":6,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.434,"5min":1.434,"15min":1.434},"min":{"1min":1.134,"5min":1.134,"15min":1.134},"max":{"1min":1.902,"5min":1.902,"15min":1.902},"last":1.443},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.150,"5min":1.150,"15min":1.150},"max":{"1min":1.963,"5min":1.963,"15min":1.963},"last":1.589}]},{"osd":7,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.835,"5min":0.835,"15min":0.835},"max":{"1min":1.842,"5min":1.842,"15min":1.842},"last":1.234},{"interface":"front","average":{"1min":59.900,"5min":59.900,"15min":59.900},"min":{"1min":0.814,"5min":0.814,"15min":0.814},"max":{"1min":822.803,"5min":822.803,"15min":822.803},"last":1.126}]},{"osd":8,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.380,"5min":1.380,"15min":1.380},"min":{"1min":0.698,"5min":0.698,"15min":0.698},"max":{"1min":1.844,"5min":1.844,"15min":1.844},"last":1.169},{"interface":"front","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.899,"5min":0.899,"15min":0.899},"max":{"1min":2.210,"5min":2.210,"15min":2.210},"last":1.354}]},{"osd":9,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.783,"5min":1.783,"15min":1.783},"min":{"1min":0.990,"5min":0.990,"15min":0.990},"max":{"1min":2.650,"5min":2.650,"15min":2.650},"last":1.670},{"interface":"front","average":{"1min":1.320,"5min":1.320,"15min":1.320},"min":{"1min":0.858,"5min":0.858,"15min":0.858},"max":{"1min":1.934,"5min":1.934,"15min":1.934},"last":0.990}]},{"osd":11,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":123.350,"5min":123.350,"15min":123.350},"min":{"1min":1.156,"5min":1.156,"15min":1.156},"max":{"1min":999.700,"5min":999.700,"15min":999.700},"last":1.554},{"interface":"front","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":1.324,"5min":1.324,"15min":1.324},"max":{"1min":2.135,"5min":2.135,"15min":2.135},"last":1.631}]}]},{"osd":9,"up_from":52,"seq":223338299418,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.613,"5min":0.613,"15min":0.613},"max":{"1min":2.541,"5min":2.541,"15min":2.541},"last":0.899},{"interface":"front","average":{"1min":1.203,"5min":1.203,"15min":1.203},"min":{"1min":0.704,"5min":0.704,"15min":0.704},"max":{"1min":2.110,"5min":2.110,"15min":2.110},"last":1.045}]},{"osd":1,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":10.914,"5min":10.914,"15min":10.914},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":167.232,"5min":167.232,"15min":167.232},"last":0.747},{"interface":"front","average":{"1min":1.189,"5min":1.189,"15min":1.189},"min":{"1min":0.789,"5min":0.789,"15min":0.789},"max":{"1min":1.844,"5min":1.844,"15min":1.844},"last":1.193}]},{"osd":2,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.210,"5min":1.210,"15min":1.210},"min":{"1min":0.739,"5min":0.739,"15min":0.739},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.093},{"interface":"front","average":{"1min":80.076,"5min":80.076,"15min":80.076},"min":{"1min":0.668,"5min":0.668,"15min":0.668},"max":{"1min":737.478,"5min":737.478,"15min":737.478},"last":1.135}]},{"osd":3,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.730,"5min":0.730,"15min":0.730},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.573},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.716,"5min":0.716,"15min":0.716},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.486}]},{"osd":4,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.720,"5min":0.720,"15min":0.720},"max":{"1min":2.723,"5min":2.723,"15min":2.723},"last":1.347},{"interface":"front","average":{"1min":1.708,"5min":1.708,"15min":1.708},"min":{"1min":1.084,"5min":1.084,"15min":1.084},"max":{"1min":4.343,"5min":4.343,"15min":4.343},"last":1.640}]},{"osd":5,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":1.242,"5min":1.242,"15min":1.242},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.299},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":1.037,"5min":1.037,"15min":1.037},"max":{"1min":2.098,"5min":2.098,"15min":2.098},"last":1.000}]},{"osd":6,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.797,"5min":1.797,"15min":1.797},"min":{"1min":1.293,"5min":1.293,"15min":1.293},"max":{"1min":4.278,"5min":4.278,"15min":4.278},"last":1.608},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":2.868,"5min":2.868,"15min":2.868},"last":1.675}]},{"osd":7,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.789,"5min":1.789,"15min":1.789},"min":{"1min":1.196,"5min":1.196,"15min":1.196},"max":{"1min":4.383,"5min":4.383,"15min":4.383},"last":1.561},{"interface":"front","average":{"1min":1.561,"5min":1.561,"15min":1.561},"min":{"1min":0.823,"5min":0.823,"15min":0.823},"max":{"1min":2.829,"5min":2.829,"15min":2.829},"last":1.251}]},{"osd":8,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.988,"15min":1.988},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":5.958,"5min":5.958,"15min":5.958},"last":1.526},{"interface":"front","average":{"1min":10.214,"5min":10.214,"15min":10.214},"min":{"1min":0.935,"5min":0.935,"15min":0.935},"max":{"1min":137.259,"5min":137.259,"15min":137.259},"last":1.426}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":1.766,"15min":1.766},"min":{"1min":1.228,"5min":1.228,"15min":1.228},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.741},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":2.753,"5min":2.753,"15min":2.753},"last":1.388}]}]},{"osd":8,"up_from":47,"seq":201863462943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.914,"5min":0.927,"15min":0.929},"min":{"1min":0.516,"5min":0.471,"15min":0.471},"max":{"1min":1.450,"5min":1.640,"15min":1.640},"last":0.728},{"interface":"front","average":{"1min":0.960,"5min":0.924,"15min":0.918},"min":{"1min":0.527,"5min":0.527,"15min":0.527},"max":{"1min":1.607,"5min":1.841,"15min":1.841},"last":0.828}]},{"osd":1,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":15.598,"5min":27.074,"15min":28.987},"min":{"1min":0.686,"5min":0.556,"15min":0.556},"max":{"1min":291.598,"5min":503.201,"15min":503.201},"last":1.173},{"interface":"front","average":{"1min":1.076,"5min":23.305,"15min":27.010},"min":{"1min":0.473,"5min":0.451,"15min":0.451},"max":{"1min":1.652,"5min":502.942,"15min":502.942},"last":0.960}]},{"osd":2,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.900,"5min":0.972,"15min":0.984},"min":{"1min":0.470,"5min":0.470,"15min":0.470},"max":{"1min":1.506,"5min":1.620,"15min":1.620},"last":0.894},{"interface":"front","average":{"1min":1.076,"5min":1.200,"15min":1.221},"min":{"1min":0.583,"5min":0.550,"15min":0.550},"max":{"1min":1.833,"5min":4.085,"15min":4.085},"last":0.769}]},{"osd":3,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.118,"5min":1.210,"15min":1.225},"min":{"1min":0.657,"5min":0.657,"15min":0.657},"max":{"1min":2.076,"5min":2.106,"15min":2.106},"last":0.808},{"interface":"front","average":{"1min":1.038,"5min":1.138,"15min":1.154},"min":{"1min":0.598,"5min":0.598,"15min":0.598},"max":{"1min":1.590,"5min":2.000,"15min":2.000},"last":1.014}]},{"osd":4,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.215,"5min":1.231,"15min":1.233},"min":{"1min":0.685,"5min":0.661,"15min":0.661},"max":{"1min":1.876,"5min":2.171,"15min":2.171},"last":1.401},{"interface":"front","average":{"1min":46.986,"5min":10.675,"15min":4.623},"min":{"1min":0.648,"5min":0.648,"15min":0.648},"max":{"1min":965.121,"5min":965.121,"15min":965.121},"last":1.072}]},{"osd":5,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.398,"5min":1.592,"15min":1.624},"min":{"1min":0.765,"5min":0.765,"15min":0.765},"max":{"1min":1.897,"5min":4.220,"15min":4.220},"last":1.335},{"interface":"front","average":{"1min":1.379,"5min":1.441,"15min":1.451},"min":{"1min":0.807,"5min":0.677,"15min":0.677},"max":{"1min":1.805,"5min":2.262,"15min":2.262},"last":1.258}]},{"osd":6,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.527,"15min":1.594},"min":{"1min":0.645,"5min":0.645,"15min":0.645},"max":{"1min":1.798,"5min":8.757,"15min":8.757},"last":1.209},{"interface":"front","average":{"1min":4.965,"5min":2.294,"15min":1.849},"min":{"1min":0.719,"5min":0.719,"15min":0.719},"max":{"1min":77.942,"5min":77.942,"15min":77.942},"last":1.140}]},{"osd":7,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.476,"15min":1.474},"min":{"1min":1.200,"5min":0.950,"15min":0.950},"max":{"1min":2.124,"5min":2.409,"15min":2.409},"last":591.738},{"interface":"front","average":{"1min":1.610,"5min":1.902,"15min":1.951},"min":{"1min":1.296,"5min":0.984,"15min":0.984},"max":{"1min":2.329,"5min":8.832,"15min":8.832},"last":1.462}]},{"osd":9,"last update":"Sun Dec 22 22:30:10 2019","interfaces":[{"interface":"back","average":{"1min":1.612,"5min":1.612,"15min":1.612},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.500},{"interface":"front","average":{"1min":1.392,"5min":1.392,"15min":1.392},"min":{"1min":0.769,"5min":0.769,"15min":0.769},"max":{"1min":2.219,"5min":2.219,"15min":2.219},"last":1.433}]},{"osd":10,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.740,"5min":0.740,"15min":0.740},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.369},{"interface":"front","average":{"1min":1.616,"5min":1.616,"15min":1.616},"min":{"1min":1.010,"5min":1.010,"15min":1.010},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.534}]}]},{"osd":7,"up_from":42,"seq":180388626467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.114,"15min":1.124},"min":{"1min":0.720,"5min":0.605,"15min":0.605},"max":{"1min":1.383,"5min":1.864,"15min":1.864},"last":0.980},{"interface":"front","average":{"1min":1.190,"5min":1.127,"15min":1.117},"min":{"1min":0.714,"5min":0.707,"15min":0.707},"max":{"1min":1.578,"5min":1.594,"15min":1.594},"last":0.845}]},{"osd":1,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":51.076,"5min":11.162,"15min":4.510},"min":{"1min":0.656,"5min":0.656,"15min":0.656},"max":{"1min":851.679,"5min":851.679,"15min":851.679},"last":0.727},{"interface":"front","average":{"1min":1.072,"5min":1.038,"15min":1.032},"min":{"1min":0.615,"5min":0.615,"15min":0.615},"max":{"1min":1.505,"5min":1.637,"15min":1.637},"last":1.141}]},{"osd":2,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.024,"15min":1.029},"min":{"1min":0.652,"5min":0.652,"15min":0.652},"max":{"1min":1.369,"5min":1.565,"15min":1.565},"last":1.254},{"interface":"front","average":{"1min":1.071,"5min":23.176,"15min":26.860},"min":{"1min":0.695,"5min":0.685,"15min":0.685},"max":{"1min":1.436,"5min":579.355,"15min":579.355},"last":1.534}]},{"osd":3,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":35.627,"5min":8.027,"15min":3.427},"min":{"1min":0.702,"5min":0.668,"15min":0.668},"max":{"1min":588.429,"5min":588.429,"15min":588.429},"last":1.196},{"interface":"front","average":{"1min":1.047,"5min":2.209,"15min":2.403},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.362,"5min":28.026,"15min":28.026},"last":1.082}]},{"osd":4,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.074,"5min":1.039,"15min":1.033},"min":{"1min":0.813,"5min":0.546,"15min":0.546},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.491},{"interface":"front","average":{"1min":1.067,"5min":1.035,"15min":1.029},"min":{"1min":0.563,"5min":0.563,"15min":0.563},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.288}]},{"osd":5,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.223,"5min":1.308,"15min":1.322},"min":{"1min":0.648,"5min":0.648,"15min":0.648},"max":{"1min":1.701,"5min":2.001,"15min":2.001},"last":1.439},{"interface":"front","average":{"1min":1.363,"5min":9.607,"15min":10.981},"min":{"1min":1.005,"5min":1.005,"15min":1.005},"max":{"1min":1.657,"5min":217.508,"15min":217.508},"last":1.365}]},{"osd":6,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.366,"5min":1.353,"15min":1.351},"min":{"1min":0.856,"5min":0.856,"15min":0.856},"max":{"1min":1.621,"5min":1.943,"15min":1.943},"last":1.402},{"interface":"front","average":{"1min":1.229,"5min":1.258,"15min":1.263},"min":{"1min":0.836,"5min":0.696,"15min":0.696},"max":{"1min":1.607,"5min":1.749,"15min":1.749},"last":1.312}]},{"osd":8,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.473,"5min":1.517,"15min":1.524},"min":{"1min":0.903,"5min":0.903,"15min":0.903},"max":{"1min":1.882,"5min":1.883,"15min":1.883},"last":1.635},{"interface":"front","average":{"1min":56.141,"5min":12.489,"15min":5.213},"min":{"1min":1.313,"5min":1.313,"15min":1.313},"max":{"1min":929.400,"5min":929.400,"15min":929.400},"last":1.601}]},{"osd":9,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.578,"5min":1.578,"15min":1.578},"min":{"1min":1.170,"5min":1.170,"15min":1.170},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.738},{"interface":"front","average":{"1min":1.651,"5min":1.651,"15min":1.651},"min":{"1min":1.501,"5min":1.501,"15min":1.501},"max":{"1min":1.892,"5min":1.892,"15min":1.892},"last":1.688}]},{"osd":10,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.604,"5min":1.604,"15min":1.604},"min":{"1min":1.199,"5min":1.199,"15min":1.199},"max":{"1min":1.951,"5min":1.951,"15min":1.951},"last":1.827},{"interface":"front","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.441,"5min":1.441,"15min":1.441},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.791}]}]},{"osd":6,"up_from":37,"seq":158913789990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.193,"15min":1.197},"min":{"1min":0.644,"5min":0.644,"15min":0.644},"max":{"1min":1.736,"5min":1.877,"15min":1.877},"last":1.646},{"interface":"front","average":{"1min":1.027,"5min":1.040,"15min":1.042},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.353,"5min":1.905,"15min":1.905},"last":1.281}]},{"osd":1,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.199,"5min":1.020,"15min":0.990},"min":{"1min":0.710,"5min":0.656,"15min":0.656},"max":{"1min":2.130,"5min":2.130,"15min":2.130},"last":0.621},{"interface":"front","average":{"1min":11.192,"5min":3.035,"15min":1.675},"min":{"1min":0.554,"5min":0.554,"15min":0.554},"max":{"1min":215.806,"5min":215.806,"15min":215.806},"last":1.098}]},{"osd":2,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.007,"5min":47.014,"15min":54.682},"min":{"1min":0.691,"5min":0.673,"15min":0.673},"max":{"1min":1.697,"5min":786.128,"15min":786.128},"last":892.790},{"interface":"front","average":{"1min":1.107,"5min":1.096,"15min":1.094},"min":{"1min":0.727,"5min":0.622,"15min":0.622},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.559}]},{"osd":3,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":0.950,"5min":1.008,"15min":1.018},"min":{"1min":0.610,"5min":0.610,"15min":0.610},"max":{"1min":1.517,"5min":1.772,"15min":1.772},"last":1.156},{"interface":"front","average":{"1min":1.061,"5min":1.040,"15min":1.036},"min":{"1min":0.682,"5min":0.682,"15min":0.682},"max":{"1min":1.628,"5min":1.628,"15min":1.628},"last":1.065}]},{"osd":4,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.009,"15min":1.003},"min":{"1min":0.640,"5min":0.544,"15min":0.544},"max":{"1min":1.656,"5min":1.920,"15min":1.920},"last":1.393},{"interface":"front","average":{"1min":1.069,"5min":0.993,"15min":0.980},"min":{"1min":0.702,"5min":0.540,"15min":0.540},"max":{"1min":1.572,"5min":1.683,"15min":1.683},"last":0.993}]},{"osd":5,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.229,"5min":1.232,"15min":1.232},"min":{"1min":0.602,"5min":0.602,"15min":0.602},"max":{"1min":1.531,"5min":2.279,"15min":2.279},"last":1.446},{"interface":"front","average":{"1min":1.443,"5min":1.478,"15min":1.484},"min":{"1min":0.958,"5min":0.958,"15min":0.958},"max":{"1min":2.034,"5min":4.535,"15min":4.535},"last":1.738}]},{"osd":7,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.435,"5min":1.350,"15min":1.336},"min":{"1min":0.638,"5min":0.638,"15min":0.638},"max":{"1min":1.963,"5min":1.963,"15min":1.963},"last":1.700},{"interface":"front","average":{"1min":1.242,"5min":1.248,"15min":1.249},"min":{"1min":0.834,"5min":0.834,"15min":0.834},"max":{"1min":1.780,"5min":1.780,"15min":1.780},"last":1.220}]},{"osd":8,"last update":"Sun Dec 22 22:30:51 2019","interfaces":[{"interface":"back","average":{"1min":43.697,"5min":9.814,"15min":4.167},"min":{"1min":0.940,"5min":0.873,"15min":0.873},"max":{"1min":449.604,"5min":449.604,"15min":449.604},"last":1.325},{"interface":"front","average":{"1min":30.044,"5min":7.260,"15min":3.462},"min":{"1min":1.353,"5min":1.272,"15min":1.272},"max":{"1min":596.398,"5min":596.398,"15min":596.398},"last":1.962}]},{"osd":9,"last update":"Sun Dec 22 22:30:07 2019","interfaces":[{"interface":"back","average":{"1min":1.695,"5min":1.695,"15min":1.695},"min":{"1min":1.340,"5min":1.340,"15min":1.340},"max":{"1min":2.784,"5min":2.784,"15min":2.784},"last":1.924},{"interface":"front","average":{"1min":1.459,"5min":1.459,"15min":1.459},"min":{"1min":1.057,"5min":1.057,"15min":1.057},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.604}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.533,"15min":1.533},"min":{"1min":1.188,"5min":1.188,"15min":1.188},"max":{"1min":2.030,"5min":2.030,"15min":2.030},"last":1.527},{"interface":"front","average":{"1min":14.761,"5min":14.761,"15min":14.761},"min":{"1min":1.040,"5min":1.040,"15min":1.040},"max":{"1min":279.809,"5min":279.809,"15min":279.809},"last":1.471}]}]},{"osd":1,"up_from":12,"seq":51539607610,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":0.799,"5min":4.913,"15min":1.997},"min":{"1min":0.481,"5min":0.301,"15min":0.301},"max":{"1min":2.181,"5min":447.710,"15min":447.710},"last":0.923},{"interface":"front","average":{"1min":31.591,"5min":6.856,"15min":2.701},"min":{"1min":0.520,"5min":0.337,"15min":0.337},"max":{"1min":522.718,"5min":522.718,"15min":522.718},"last":0.620}]},{"osd":2,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":0.868,"5min":0.749,"15min":0.698},"min":{"1min":0.582,"5min":0.431,"15min":0.431},"max":{"1min":1.490,"5min":1.490,"15min":1.490},"last":0.782},{"interface":"front","average":{"1min":0.860,"5min":0.746,"15min":0.701},"min":{"1min":0.515,"5min":0.496,"15min":0.496},"max":{"1min":1.336,"5min":1.336,"15min":1.336},"last":0.663}]},{"osd":3,"last update":"Sun Dec 22 22:30:20 2019","interfaces":[{"interface":"back","average":{"1min":0.850,"5min":0.789,"15min":0.771},"min":{"1min":0.534,"5min":0.534,"15min":0.534},"max":{"1min":1.428,"5min":1.428,"15min":1.428},"last":1.049},{"interface":"front","average":{"1min":0.991,"5min":7.186,"15min":3.012},"min":{"1min":0.723,"5min":0.691,"15min":0.691},"max":{"1min":1.316,"5min":686.743,"15min":686.743},"last":1.309}]},{"osd":4,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":1.008,"15min":0.979},"min":{"1min":0.750,"5min":0.488,"15min":0.488},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.081},{"interface":"front","average":{"1min":51.506,"5min":11.073,"15min":4.301},"min":{"1min":0.765,"5min":0.710,"15min":0.710},"max":{"1min":856.751,"5min":856.751,"15min":856.751},"last":1.198}]},{"osd":5,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":1.257,"5min":1.102,"15min":1.053},"min":{"1min":0.657,"5min":0.657,"15min":0.657},"max":{"1min":2.315,"5min":2.315,"15min":2.315},"last":1.160},{"interface":"front","average":{"1min":1.255,"5min":1.143,"15min":1.107},"min":{"1min":0.931,"5min":0.768,"15min":0.768},"max":{"1min":1.822,"5min":1.822,"15min":1.822},"last":1.351}]},{"osd":6,"last update":"Sun Dec 22 22:30:10 2019","interfaces":[{"interface":"back","average":{"1min":20.627,"5min":5.019,"15min":2.417},"min":{"1min":0.795,"5min":0.678,"15min":0.678},"max":{"1min":350.575,"5min":350.575,"15min":350.575},"last":1.119},{"interface":"front","average":{"1min":1.292,"5min":1.183,"15min":1.165},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.022,"5min":2.022,"15min":2.022},"last":1.388}]},{"osd":7,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":50.092,"5min":11.052,"15min":4.546},"min":{"1min":0.661,"5min":0.661,"15min":0.661},"max":{"1min":830.970,"5min":830.970,"15min":830.970},"last":1.438},{"interface":"front","average":{"1min":1.229,"5min":1.322,"15min":1.338},"min":{"1min":0.868,"5min":0.868,"15min":0.868},"max":{"1min":1.679,"5min":2.080,"15min":2.080},"last":1.529}]},{"osd":8,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":31.817,"5min":58.579,"15min":63.039},"min":{"1min":0.990,"5min":0.894,"15min":0.894},"max":{"1min":487.747,"5min":993.474,"15min":993.474},"last":1.490},{"interface":"front","average":{"1min":34.569,"5min":8.068,"15min":3.651},"min":{"1min":1.040,"5min":1.040,"15min":1.040},"max":{"1min":532.136,"5min":532.136,"15min":532.136},"last":1.465}]},{"osd":9,"last update":"Sun Dec 22 22:30:10 2019","interfaces":[{"interface":"back","average":{"1min":39.121,"5min":39.121,"15min":39.121},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":715.827,"5min":715.827,"15min":715.827},"last":1.585},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.255}]},{"osd":10,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.102,"5min":2.102,"15min":2.102},"last":1.639},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":1.213,"5min":1.213,"15min":1.213},"max":{"1min":2.140,"5min":2.140,"15min":2.140},"last":1.676}]}]},{"osd":0,"up_from":7,"seq":30064771135,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":0.792,"5min":1.323,"15min":0.793},"min":{"1min":0.493,"5min":0.346,"15min":0.346},"max":{"1min":1.382,"5min":68.607,"15min":68.607},"last":0.686},{"interface":"front","average":{"1min":19.114,"5min":4.388,"15min":1.857},"min":{"1min":0.583,"5min":0.404,"15min":0.404},"max":{"1min":381.781,"5min":381.781,"15min":381.781},"last":0.615}]},{"osd":2,"last update":"Sun Dec 22 22:28:51 2019","interfaces":[{"interface":"back","average":{"1min":23.953,"5min":5.351,"15min":2.251},"min":{"1min":0.488,"5min":0.444,"15min":0.444},"max":{"1min":501.694,"5min":501.694,"15min":501.694},"last":1.446},{"interface":"front","average":{"1min":22.535,"5min":5.030,"15min":2.112},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":501.287,"5min":501.287,"15min":501.287},"last":0.805}]},{"osd":3,"last update":"Sun Dec 22 22:30:15 2019","interfaces":[{"interface":"back","average":{"1min":0.912,"5min":0.755,"15min":0.696},"min":{"1min":0.593,"5min":0.523,"15min":0.523},"max":{"1min":1.483,"5min":1.483,"15min":1.483},"last":0.852},{"interface":"front","average":{"1min":31.437,"5min":6.969,"15min":2.875},"min":{"1min":0.564,"5min":0.564,"15min":0.564},"max":{"1min":548.602,"5min":548.602,"15min":548.602},"last":0.573}]},{"osd":4,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":1.130,"5min":1.103,"15min":1.091},"min":{"1min":0.787,"5min":0.680,"15min":0.680},"max":{"1min":1.773,"5min":2.152,"15min":2.152},"last":0.730},{"interface":"front","average":{"1min":1.056,"5min":16.051,"15min":6.020},"min":{"1min":0.723,"5min":0.723,"15min":0.723},"max":{"1min":1.526,"5min":995.256,"15min":995.256},"last":0.801}]},{"osd":5,"last update":"Sun Dec 22 22:30:56 2019","interfaces":[{"interface":"back","average":{"1min":1.290,"5min":1.155,"15min":1.111},"min":{"1min":0.864,"5min":0.819,"15min":0.819},"max":{"1min":1.933,"5min":1.933,"15min":1.933},"last":0.987},{"interface":"front","average":{"1min":35.092,"5min":7.988,"15min":3.436},"min":{"1min":0.793,"5min":0.671,"15min":0.671},"max":{"1min":677.586,"5min":677.586,"15min":677.586},"last":1.019}]},{"osd":6,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.364,"5min":1.238,"15min":1.217},"min":{"1min":0.733,"5min":0.709,"15min":0.709},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.760},{"interface":"front","average":{"1min":1.261,"5min":1.236,"15min":1.232},"min":{"1min":0.805,"5min":0.805,"15min":0.805},"max":{"1min":1.733,"5min":1.733,"15min":1.733},"last":0.956}]},{"osd":7,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.324,"5min":1.251,"15min":1.239},"min":{"1min":0.891,"5min":0.827,"15min":0.827},"max":{"1min":1.935,"5min":1.935,"15min":1.935},"last":1.164},{"interface":"front","average":{"1min":1.424,"5min":1.290,"15min":1.268},"min":{"1min":1.002,"5min":0.957,"15min":0.957},"max":{"1min":2.098,"5min":2.098,"15min":2.098},"last":1.076}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.553,"5min":1.544,"15min":1.542},"min":{"1min":1.185,"5min":0.964,"15min":0.964},"max":{"1min":2.131,"5min":2.341,"15min":2.341},"last":0.916},{"interface":"front","average":{"1min":1.462,"5min":1.435,"15min":1.431},"min":{"1min":0.856,"5min":0.856,"15min":0.856},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1.315}]},{"osd":9,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.592,"5min":1.592,"15min":1.592},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.050},{"interface":"front","average":{"1min":1.483,"5min":1.483,"15min":1.483},"min":{"1min":0.974,"5min":0.974,"15min":0.974},"max":{"1min":2.280,"5min":2.280,"15min":2.280},"last":1.110}]},{"osd":10,"last update":"Sun Dec 22 22:30:28 2019","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":2.408,"5min":2.408,"15min":2.408},"last":1.196},{"interface":"front","average":{"1min":1.477,"5min":1.477,"15min":1.477},"min":{"1min":0.889,"5min":0.889,"15min":0.889},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.236}]},{"osd":11,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":23.924,"5min":23.924,"15min":23.924},"min":{"1min":1.013,"5min":1.013,"15min":1.013},"max":{"1min":467.930,"5min":467.930,"15min":467.930},"last":1.139},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":1.242,"5min":1.242,"15min":1.242},"max":{"1min":2.114,"5min":2.114,"15min":2.114},"last":1.275}]}]},{"osd":2,"up_from":17,"seq":73014444085,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":0.884,"5min":0.707,"15min":0.617},"min":{"1min":0.411,"5min":0.411,"15min":0.411},"max":{"1min":1.677,"5min":1.863,"15min":1.863},"last":1.115},{"interface":"front","average":{"1min":0.934,"5min":3.822,"15min":1.704},"min":{"1min":0.539,"5min":0.315,"15min":0.315},"max":{"1min":1.642,"5min":272.186,"15min":272.186},"last":0.968}]},{"osd":1,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":0.953,"5min":4.723,"15min":1.993},"min":{"1min":0.438,"5min":0.391,"15min":0.391},"max":{"1min":1.821,"5min":357.558,"15min":357.558},"last":1.284},{"interface":"front","average":{"1min":0.953,"5min":0.834,"15min":0.716},"min":{"1min":0.492,"5min":0.390,"15min":0.390},"max":{"1min":2.259,"5min":2.259,"15min":2.259},"last":1.185}]},{"osd":3,"last update":"Sun Dec 22 22:30:15 2019","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.901,"15min":0.868},"min":{"1min":0.602,"5min":0.602,"15min":0.602},"max":{"1min":2.182,"5min":2.182,"15min":2.182},"last":0.846},{"interface":"front","average":{"1min":0.841,"5min":0.748,"15min":0.705},"min":{"1min":0.484,"5min":0.484,"15min":0.484},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.225}]},{"osd":4,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.122,"5min":1.053,"15min":1.031},"min":{"1min":0.666,"5min":0.666,"15min":0.666},"max":{"1min":2.111,"5min":2.111,"15min":2.111},"last":0.714},{"interface":"front","average":{"1min":1.253,"5min":1.062,"15min":1.018},"min":{"1min":0.931,"5min":0.664,"15min":0.664},"max":{"1min":2.045,"5min":2.045,"15min":2.045},"last":1.435}]},{"osd":5,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":50.784,"5min":13.329,"15min":7.725},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":944.730,"5min":944.730,"15min":944.730},"last":1.022},{"interface":"front","average":{"1min":1.290,"5min":1.148,"15min":1.106},"min":{"1min":0.671,"5min":0.671,"15min":0.671},"max":{"1min":2.526,"5min":2.526,"15min":2.526},"last":1.623}]},{"osd":6,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.311,"5min":1.255,"15min":1.246},"min":{"1min":0.743,"5min":0.743,"15min":0.743},"max":{"1min":2.381,"5min":2.381,"15min":2.381},"last":1.346},{"interface":"front","average":{"1min":1.259,"5min":1.252,"15min":1.251},"min":{"1min":0.867,"5min":0.797,"15min":0.797},"max":{"1min":2.467,"5min":2.467,"15min":2.467},"last":0.757}]},{"osd":7,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.487,"5min":1.336,"15min":1.311},"min":{"1min":0.860,"5min":0.860,"15min":0.860},"max":{"1min":2.811,"5min":2.811,"15min":2.811},"last":1.667},{"interface":"front","average":{"1min":1.588,"5min":17.128,"15min":19.718},"min":{"1min":1.030,"5min":1.030,"15min":1.030},"max":{"1min":2.874,"5min":412.794,"15min":412.794},"last":1.771}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.382,"5min":1.450,"15min":1.461},"min":{"1min":0.632,"5min":0.632,"15min":0.632},"max":{"1min":2.672,"5min":2.672,"15min":2.672},"last":1.399},{"interface":"front","average":{"1min":1.487,"5min":1.378,"15min":1.360},"min":{"1min":0.690,"5min":0.690,"15min":0.690},"max":{"1min":2.420,"5min":2.420,"15min":2.420},"last":1.736}]},{"osd":9,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.890,"5min":0.890,"15min":0.890},"max":{"1min":2.757,"5min":2.757,"15min":2.757},"last":1.471},{"interface":"front","average":{"1min":1.530,"5min":1.530,"15min":1.530},"min":{"1min":1.045,"5min":1.045,"15min":1.045},"max":{"1min":2.619,"5min":2.619,"15min":2.619},"last":1.703}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":54.553,"5min":54.553,"15min":54.553},"min":{"1min":1.147,"5min":1.147,"15min":1.147},"max":{"1min":501.863,"5min":501.863,"15min":501.863},"last":1.522},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.704,"5min":2.704,"15min":2.704},"last":449.841}]}]},{"osd":3,"up_from":22,"seq":94489280563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:29:14 2019","interfaces":[{"interface":"back","average":{"1min":0.843,"5min":0.692,"15min":0.667},"min":{"1min":0.625,"5min":0.474,"15min":0.474},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.609},{"interface":"front","average":{"1min":0.867,"5min":0.742,"15min":0.721},"min":{"1min":0.556,"5min":0.527,"15min":0.527},"max":{"1min":1.555,"5min":1.555,"15min":1.555},"last":0.707}]},{"osd":1,"last update":"Sun Dec 22 22:30:18 2019","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.797,"15min":0.784},"min":{"1min":0.415,"5min":0.415,"15min":0.415},"max":{"1min":1.527,"5min":1.527,"15min":1.527},"last":0.989},{"interface":"front","average":{"1min":0.922,"5min":5.827,"15min":2.559},"min":{"1min":0.511,"5min":0.511,"15min":0.511},"max":{"1min":3.372,"5min":467.732,"15min":467.732},"last":1.199}]},{"osd":2,"last update":"Sun Dec 22 22:30:18 2019","interfaces":[{"interface":"back","average":{"1min":29.972,"5min":6.561,"15min":2.632},"min":{"1min":0.485,"5min":0.485,"15min":0.485},"max":{"1min":667.845,"5min":667.845,"15min":667.845},"last":1.486},{"interface":"front","average":{"1min":0.948,"5min":0.829,"15min":0.776},"min":{"1min":0.523,"5min":0.455,"15min":0.455},"max":{"1min":1.940,"5min":1.940,"15min":1.940},"last":0.761}]},{"osd":4,"last update":"Sun Dec 22 22:30:37 2019","interfaces":[{"interface":"back","average":{"1min":1.265,"5min":1.121,"15min":1.067},"min":{"1min":0.772,"5min":0.652,"15min":0.652},"max":{"1min":2.961,"5min":2.961,"15min":2.961},"last":1.419},{"interface":"front","average":{"1min":1.312,"5min":1.158,"15min":1.102},"min":{"1min":0.886,"5min":0.750,"15min":0.750},"max":{"1min":2.845,"5min":2.845,"15min":2.845},"last":1.680}]},{"osd":5,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.974,"5min":1.756,"15min":1.998},"min":{"1min":0.609,"5min":0.609,"15min":0.609},"max":{"1min":1.561,"5min":24.295,"15min":24.295},"last":1.303},{"interface":"front","average":{"1min":1.131,"5min":1.160,"15min":1.118},"min":{"1min":0.776,"5min":0.776,"15min":0.776},"max":{"1min":1.786,"5min":2.312,"15min":2.312},"last":1.589}]},{"osd":6,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":36.679,"5min":8.283,"15min":3.551},"min":{"1min":0.850,"5min":0.850,"15min":0.850},"max":{"1min":501.935,"5min":501.935,"15min":501.935},"last":1.088},{"interface":"front","average":{"1min":1.414,"5min":1.308,"15min":1.290},"min":{"1min":0.647,"5min":0.647,"15min":0.647},"max":{"1min":2.155,"5min":2.155,"15min":2.155},"last":1.145}]},{"osd":7,"last update":"Sun Dec 22 22:30:37 2019","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.387,"15min":1.393},"min":{"1min":0.804,"5min":0.804,"15min":0.804},"max":{"1min":3.156,"5min":3.156,"15min":3.156},"last":1.841},{"interface":"front","average":{"1min":1.261,"5min":1.340,"15min":1.353},"min":{"1min":0.650,"5min":0.650,"15min":0.650},"max":{"1min":2.523,"5min":2.523,"15min":2.523},"last":1.257}]},{"osd":8,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.320,"5min":34.304,"15min":39.801},"min":{"1min":0.811,"5min":0.811,"15min":0.811},"max":{"1min":1.970,"5min":820.143,"15min":820.143},"last":1.726},{"interface":"front","average":{"1min":15.298,"5min":4.367,"15min":2.545},"min":{"1min":0.840,"5min":0.840,"15min":0.840},"max":{"1min":292.729,"5min":292.729,"15min":292.729},"last":1.933}]},{"osd":9,"last update":"Sun Dec 22 22:30:09 2019","interfaces":[{"interface":"back","average":{"1min":1.620,"5min":1.620,"15min":1.620},"min":{"1min":1.144,"5min":1.144,"15min":1.144},"max":{"1min":2.592,"5min":2.592,"15min":2.592},"last":1.903},{"interface":"front","average":{"1min":1.600,"5min":1.600,"15min":1.600},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":3.233,"5min":3.233,"15min":3.233},"last":1.642}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":15.340,"5min":15.340,"15min":15.340},"min":{"1min":0.821,"5min":0.821,"15min":0.821},"max":{"1min":280.174,"5min":280.174,"15min":280.174},"last":1.387},{"interface":"front","average":{"1min":43.049,"5min":43.049,"15min":43.049},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":832.650,"5min":832.650,"15min":832.650},"last":1.521}]},{"osd":11,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":20.768,"5min":20.768,"15min":20.768},"min":{"1min":0.910,"5min":0.910,"15min":0.910},"max":{"1min":427.022,"5min":427.022,"15min":427.022},"last":1.790},{"interface":"front","average":{"1min":37.520,"5min":37.520,"15min":37.520},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":792.516,"5min":792.516,"15min":792.516},"last":1.872}]}]},{"osd":4,"up_from":27,"seq":115964117037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.055,"5min":1.073,"15min":1.069},"min":{"1min":0.652,"5min":0.649,"15min":0.649},"max":{"1min":1.479,"5min":1.942,"15min":1.942},"last":1.007},{"interface":"front","average":{"1min":1.173,"5min":1.107,"15min":1.098},"min":{"1min":0.824,"5min":0.721,"15min":0.721},"max":{"1min":1.620,"5min":1.876,"15min":1.876},"last":0.821}]},{"osd":1,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":0.977,"5min":0.935,"15min":0.905},"min":{"1min":0.603,"5min":0.580,"15min":0.580},"max":{"1min":1.453,"5min":1.546,"15min":1.546},"last":0.594},{"interface":"front","average":{"1min":1.038,"5min":3.901,"15min":1.927},"min":{"1min":0.678,"5min":0.629,"15min":0.629},"max":{"1min":1.547,"5min":277.064,"15min":277.064},"last":0.854}]},{"osd":2,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":15.435,"15min":21.785},"min":{"1min":0.827,"5min":0.757,"15min":0.757},"max":{"1min":1.636,"5min":430.289,"15min":430.289},"last":1.383},{"interface":"front","average":{"1min":37.352,"5min":18.552,"15min":6.938},"min":{"1min":0.926,"5min":0.743,"15min":0.743},"max":{"1min":831.842,"5min":967.982,"15min":967.982},"last":1.441}]},{"osd":3,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":1.050,"15min":1.015},"min":{"1min":0.762,"5min":0.585,"15min":0.585},"max":{"1min":1.521,"5min":1.728,"15min":1.728},"last":1.085},{"interface":"front","average":{"1min":1.029,"5min":10.775,"15min":4.207},"min":{"1min":0.670,"5min":0.636,"15min":0.636},"max":{"1min":1.518,"5min":929.402,"15min":929.402},"last":0.932}]},{"osd":5,"last update":"Sun Dec 22 22:30:56 2019","interfaces":[{"interface":"back","average":{"1min":1.140,"5min":1.002,"15min":0.962},"min":{"1min":0.713,"5min":0.509,"15min":0.509},"max":{"1min":1.563,"5min":1.905,"15min":1.905},"last":0.718},{"interface":"front","average":{"1min":1.331,"5min":1.114,"15min":1.056},"min":{"1min":0.613,"5min":0.484,"15min":0.484},"max":{"1min":1.683,"5min":1.683,"15min":1.683},"last":1.486}]},{"osd":6,"last update":"Sun Dec 22 22:30:16 2019","interfaces":[{"interface":"back","average":{"1min":84.896,"5min":17.852,"15min":6.678},"min":{"1min":0.782,"5min":0.680,"15min":0.680},"max":{"1min":529.309,"5min":529.309,"15min":529.309},"last":0.967},{"interface":"front","average":{"1min":1.195,"5min":1.243,"15min":1.251},"min":{"1min":0.825,"5min":0.600,"15min":0.600},"max":{"1min":1.645,"5min":1.707,"15min":1.707},"last":0.785}]},{"osd":7,"last update":"Sun Dec 22 22:30:34 2019","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.259,"15min":1.247},"min":{"1min":0.783,"5min":0.623,"15min":0.623},"max":{"1min":1.678,"5min":1.678,"15min":1.678},"last":0.757},{"interface":"front","average":{"1min":1.228,"5min":1.299,"15min":1.311},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.721,"5min":1.721,"15min":1.721},"last":1.300}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.430,"5min":26.380,"15min":30.538},"min":{"1min":1.150,"5min":1.111,"15min":1.111},"max":{"1min":1.814,"5min":531.221,"15min":531.221},"last":1.577},{"interface":"front","average":{"1min":1.648,"5min":1.518,"15min":1.496},"min":{"1min":1.275,"5min":0.951,"15min":0.951},"max":{"1min":1.932,"5min":1.932,"15min":1.932},"last":1.515}]},{"osd":9,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":1.590,"5min":1.590,"15min":1.590},"min":{"1min":0.977,"5min":0.977,"15min":0.977},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.540},{"interface":"front","average":{"1min":51.652,"5min":51.652,"15min":51.652},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":904.459,"5min":904.459,"15min":904.459},"last":1.405}]},{"osd":10,"last update":"Sun Dec 22 22:30:28 2019","interfaces":[{"interface":"back","average":{"1min":14.077,"5min":14.077,"15min":14.077},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":275.538,"5min":275.538,"15min":275.538},"last":1.404},{"interface":"front","average":{"1min":1.658,"5min":1.658,"15min":1.658},"min":{"1min":1.020,"5min":1.020,"15min":1.020},"max":{"1min":1.951,"5min":1.951,"15min":1.951},"last":1.972}]}]},{"osd":5,"up_from":32,"seq":137438953514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":5.148,"5min":1.819,"15min":1.260},"min":{"1min":0.760,"5min":0.568,"15min":0.568},"max":{"1min":75.068,"5min":75.068,"15min":75.068},"last":0.717},{"interface":"front","average":{"1min":1.262,"5min":1.041,"15min":0.969},"min":{"1min":0.680,"5min":0.630,"15min":0.630},"max":{"1min":5.292,"5min":5.292,"15min":5.292},"last":1.186}]},{"osd":1,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.259,"5min":24.901,"15min":35.449},"min":{"1min":0.780,"5min":0.453,"15min":0.453},"max":{"1min":5.195,"5min":637.713,"15min":637.713},"last":0.864},{"interface":"front","average":{"1min":1.231,"5min":1.080,"15min":1.043},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":5.080,"5min":5.080,"15min":5.080},"last":0.910}]},{"osd":2,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.328,"5min":1.015,"15min":0.943},"min":{"1min":0.759,"5min":0.526,"15min":0.526},"max":{"1min":5.239,"5min":5.239,"15min":5.239},"last":1.326},{"interface":"front","average":{"1min":48.970,"5min":10.645,"15min":4.233},"min":{"1min":0.614,"5min":0.614,"15min":0.614},"max":{"1min":906.443,"5min":906.443,"15min":906.443},"last":1.011}]},{"osd":3,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":32.944,"5min":7.425,"15min":3.155},"min":{"1min":0.684,"5min":0.544,"15min":0.544},"max":{"1min":601.608,"5min":601.608,"15min":601.608},"last":0.963},{"interface":"front","average":{"1min":1.403,"5min":1.143,"15min":1.075},"min":{"1min":0.733,"5min":0.581,"15min":0.581},"max":{"1min":5.351,"5min":5.351,"15min":5.351},"last":1.270}]},{"osd":4,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.059,"5min":5.945,"15min":2.619},"min":{"1min":0.575,"5min":0.426,"15min":0.426},"max":{"1min":2.019,"5min":447.758,"15min":447.758},"last":1.377},{"interface":"front","average":{"1min":1.242,"5min":1.117,"15min":1.061},"min":{"1min":0.766,"5min":0.368,"15min":0.368},"max":{"1min":1.561,"5min":1.862,"15min":1.862},"last":1.547}]},{"osd":6,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":1.285,"5min":1.114,"15min":1.086},"min":{"1min":0.825,"5min":0.336,"15min":0.336},"max":{"1min":1.717,"5min":1.818,"15min":1.818},"last":1.110},{"interface":"front","average":{"1min":1.283,"5min":1.199,"15min":1.185},"min":{"1min":0.757,"5min":0.497,"15min":0.497},"max":{"1min":2.058,"5min":2.058,"15min":2.058},"last":1.054}]},{"osd":7,"last update":"Sun Dec 22 22:30:33 2019","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.285,"15min":1.266},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.463},{"interface":"front","average":{"1min":1.439,"5min":1.338,"15min":1.321},"min":{"1min":0.805,"5min":0.697,"15min":0.697},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.424}]},{"osd":8,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.507,"15min":1.503},"min":{"1min":0.895,"5min":0.895,"15min":0.895},"max":{"1min":1.842,"5min":2.214,"15min":2.214},"last":1.622},{"interface":"front","average":{"1min":1.473,"5min":1.465,"15min":1.463},"min":{"1min":1.043,"5min":1.014,"15min":1.014},"max":{"1min":2.236,"5min":2.258,"15min":2.258},"last":1.659}]},{"osd":9,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.563,"15min":1.563},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":2.172,"5min":2.172,"15min":2.172},"last":1.738},{"interface":"front","average":{"1min":57.350,"5min":57.350,"15min":57.350},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":746.735,"5min":746.735,"15min":746.735},"last":1.703}]},{"osd":10,"last update":"Sun Dec 22 22:30:33 2019","interfaces":[{"interface":"back","average":{"1min":1.596,"5min":1.596,"15min":1.596},"min":{"1min":1.132,"5min":1.132,"15min":1.132},"max":{"1min":2.338,"5min":2.338,"15min":2.338},"last":1.499},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.368,"5min":1.368,"15min":1.368},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.788}]}]}]}} 2019-12-22T22:31:07.517 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph pg dump --format=json 2019-12-22T22:31:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:31:09.649 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2019-12-22T22:31:10.244 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2019-12-22T22:31:08.081948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124941824,"kb_used":12589824,"kb_used_data":6288,"kb_used_omap":0,"kb_used_meta":12582912,"kb_avail":1112352000,"statfs":{"total":1151940427776,"available":1139048448000,"internally_reserved":12884901888,"allocated":6438912,"data_stored":2780328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12884901888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":15.516,"5min":15.516,"15min":15.516},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":294.724,"5min":294.724,"15min":294.724},"last":1.500},{"interface":"front","average":{"1min":29.217,"5min":29.217,"15min":29.217},"min":{"1min":0.681,"5min":0.681,"15min":0.681},"max":{"1min":567.422,"5min":567.422,"15min":567.422},"last":1.621}]},{"osd":1,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":0.957,"5min":0.957,"15min":0.957},"min":{"1min":0.610,"5min":0.610,"15min":0.610},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.587},{"interface":"front","average":{"1min":46.470,"5min":46.470,"15min":46.470},"min":{"1min":0.854,"5min":0.854,"15min":0.854},"max":{"1min":899.728,"5min":899.728,"15min":899.728},"last":1.719}]},{"osd":2,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":0.946,"5min":0.946,"15min":0.946},"min":{"1min":0.607,"5min":0.607,"15min":0.607},"max":{"1min":1.493,"5min":1.493,"15min":1.493},"last":1.526},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.685,"5min":0.685,"15min":0.685},"max":{"1min":1.529,"5min":1.529,"15min":1.529},"last":1.466}]},{"osd":3,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.168,"5min":1.168,"15min":1.168},"min":{"1min":0.813,"5min":0.813,"15min":0.813},"max":{"1min":1.850,"5min":1.850,"15min":1.850},"last":1.385},{"interface":"front","average":{"1min":1.729,"5min":1.729,"15min":1.729},"min":{"1min":0.880,"5min":0.880,"15min":0.880},"max":{"1min":11.220,"5min":11.220,"15min":11.220},"last":1.673}]},{"osd":4,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.783,"5min":1.783,"15min":1.783},"min":{"1min":1.001,"5min":1.001,"15min":1.001},"max":{"1min":11.106,"5min":11.106,"15min":11.106},"last":0.896},{"interface":"front","average":{"1min":1.313,"5min":1.313,"15min":1.313},"min":{"1min":0.939,"5min":0.939,"15min":0.939},"max":{"1min":1.689,"5min":1.689,"15min":1.689},"last":0.705}]},{"osd":5,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.396,"5min":1.396,"15min":1.396},"min":{"1min":1.167,"5min":1.167,"15min":1.167},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.251},{"interface":"front","average":{"1min":1.983,"5min":1.983,"15min":1.983},"min":{"1min":1.208,"5min":1.208,"15min":1.208},"max":{"1min":11.156,"5min":11.156,"15min":11.156},"last":1.222}]},{"osd":6,"last update":"Sun Dec 22 22:30:48 2019","interfaces":[{"interface":"back","average":{"1min":53.038,"5min":53.038,"15min":53.038},"min":{"1min":0.972,"5min":0.972,"15min":0.972},"max":{"1min":502.058,"5min":502.058,"15min":502.058},"last":1.107},{"interface":"front","average":{"1min":27.795,"5min":27.795,"15min":27.795},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":501.852,"5min":501.852,"15min":501.852},"last":1.163}]},{"osd":7,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.128,"5min":2.128,"15min":2.128},"last":1.303},{"interface":"front","average":{"1min":25.185,"5min":25.185,"15min":25.185},"min":{"1min":1.312,"5min":1.312,"15min":1.312},"max":{"1min":473.675,"5min":473.675,"15min":473.675},"last":0.969}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":37.192,"5min":37.192,"15min":37.192},"min":{"1min":1.274,"5min":1.274,"15min":1.274},"max":{"1min":502.226,"5min":502.226,"15min":502.226},"last":0.804},{"interface":"front","average":{"1min":1.682,"5min":1.682,"15min":1.682},"min":{"1min":1.399,"5min":1.399,"15min":1.399},"max":{"1min":2.170,"5min":2.170,"15min":2.170},"last":1.047}]},{"osd":10,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":2.178,"5min":2.178,"15min":2.178},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":11.281,"5min":11.281,"15min":11.281},"last":1.354},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.292,"5min":1.292,"15min":1.292},"max":{"1min":2.271,"5min":2.271,"15min":2.271},"last":1.409}]}]},{"osd":10,"up_from":58,"seq":249108103190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.608}]},{"osd":1,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.932,"5min":0.932,"15min":0.932},"min":{"1min":0.632,"5min":0.632,"15min":0.632},"max":{"1min":1.400,"5min":1.400,"15min":1.400},"last":0.916},{"interface":"front","average":{"1min":1.049,"5min":1.049,"15min":1.049},"min":{"1min":0.702,"5min":0.702,"15min":0.702},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.402}]},{"osd":2,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.994,"5min":0.994,"15min":0.994},"min":{"1min":0.729,"5min":0.729,"15min":0.729},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.311},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.790,"5min":0.790,"15min":0.790},"max":{"1min":1.710,"5min":1.710,"15min":1.710},"last":1.086}]},{"osd":3,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.927,"5min":0.927,"15min":0.927},"min":{"1min":0.678,"5min":0.678,"15min":0.678},"max":{"1min":1.574,"5min":1.574,"15min":1.574},"last":0.846},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.639,"5min":0.639,"15min":0.639},"max":{"1min":1.497,"5min":1.497,"15min":1.497},"last":1.030}]},{"osd":4,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.732,"5min":0.732,"15min":0.732},"max":{"1min":1.811,"5min":1.811,"15min":1.811},"last":1.201},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.540,"5min":1.540,"15min":1.540},"last":1.480}]},{"osd":5,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.515,"5min":1.515,"15min":1.515},"min":{"1min":0.902,"5min":0.902,"15min":0.902},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.275},{"interface":"front","average":{"1min":1.291,"5min":1.291,"15min":1.291},"min":{"1min":0.794,"5min":0.794,"15min":0.794},"max":{"1min":1.981,"5min":1.981,"15min":1.981},"last":1.516}]},{"osd":6,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.434,"5min":1.434,"15min":1.434},"min":{"1min":1.134,"5min":1.134,"15min":1.134},"max":{"1min":1.902,"5min":1.902,"15min":1.902},"last":1.443},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.150,"5min":1.150,"15min":1.150},"max":{"1min":1.963,"5min":1.963,"15min":1.963},"last":1.589}]},{"osd":7,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.835,"5min":0.835,"15min":0.835},"max":{"1min":1.842,"5min":1.842,"15min":1.842},"last":1.234},{"interface":"front","average":{"1min":59.900,"5min":59.900,"15min":59.900},"min":{"1min":0.814,"5min":0.814,"15min":0.814},"max":{"1min":822.803,"5min":822.803,"15min":822.803},"last":1.126}]},{"osd":8,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.380,"5min":1.380,"15min":1.380},"min":{"1min":0.698,"5min":0.698,"15min":0.698},"max":{"1min":1.844,"5min":1.844,"15min":1.844},"last":1.169},{"interface":"front","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.899,"5min":0.899,"15min":0.899},"max":{"1min":2.210,"5min":2.210,"15min":2.210},"last":1.354}]},{"osd":9,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.783,"5min":1.783,"15min":1.783},"min":{"1min":0.990,"5min":0.990,"15min":0.990},"max":{"1min":2.650,"5min":2.650,"15min":2.650},"last":1.670},{"interface":"front","average":{"1min":1.320,"5min":1.320,"15min":1.320},"min":{"1min":0.858,"5min":0.858,"15min":0.858},"max":{"1min":1.934,"5min":1.934,"15min":1.934},"last":0.990}]},{"osd":11,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":123.350,"5min":123.350,"15min":123.350},"min":{"1min":1.156,"5min":1.156,"15min":1.156},"max":{"1min":999.700,"5min":999.700,"15min":999.700},"last":1.554},{"interface":"front","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":1.324,"5min":1.324,"15min":1.324},"max":{"1min":2.135,"5min":2.135,"15min":2.135},"last":1.631}]}]},{"osd":9,"up_from":52,"seq":223338299418,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.613,"5min":0.613,"15min":0.613},"max":{"1min":2.541,"5min":2.541,"15min":2.541},"last":0.899},{"interface":"front","average":{"1min":1.203,"5min":1.203,"15min":1.203},"min":{"1min":0.704,"5min":0.704,"15min":0.704},"max":{"1min":2.110,"5min":2.110,"15min":2.110},"last":1.045}]},{"osd":1,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":10.914,"5min":10.914,"15min":10.914},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":167.232,"5min":167.232,"15min":167.232},"last":0.747},{"interface":"front","average":{"1min":1.189,"5min":1.189,"15min":1.189},"min":{"1min":0.789,"5min":0.789,"15min":0.789},"max":{"1min":1.844,"5min":1.844,"15min":1.844},"last":1.193}]},{"osd":2,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.210,"5min":1.210,"15min":1.210},"min":{"1min":0.739,"5min":0.739,"15min":0.739},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.093},{"interface":"front","average":{"1min":80.076,"5min":80.076,"15min":80.076},"min":{"1min":0.668,"5min":0.668,"15min":0.668},"max":{"1min":737.478,"5min":737.478,"15min":737.478},"last":1.135}]},{"osd":3,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.730,"5min":0.730,"15min":0.730},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.573},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.716,"5min":0.716,"15min":0.716},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.486}]},{"osd":4,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.720,"5min":0.720,"15min":0.720},"max":{"1min":2.723,"5min":2.723,"15min":2.723},"last":1.347},{"interface":"front","average":{"1min":1.708,"5min":1.708,"15min":1.708},"min":{"1min":1.084,"5min":1.084,"15min":1.084},"max":{"1min":4.343,"5min":4.343,"15min":4.343},"last":1.640}]},{"osd":5,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":1.242,"5min":1.242,"15min":1.242},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.299},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":1.037,"5min":1.037,"15min":1.037},"max":{"1min":2.098,"5min":2.098,"15min":2.098},"last":1.000}]},{"osd":6,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.797,"5min":1.797,"15min":1.797},"min":{"1min":1.293,"5min":1.293,"15min":1.293},"max":{"1min":4.278,"5min":4.278,"15min":4.278},"last":1.608},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":2.868,"5min":2.868,"15min":2.868},"last":1.675}]},{"osd":7,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.789,"5min":1.789,"15min":1.789},"min":{"1min":1.196,"5min":1.196,"15min":1.196},"max":{"1min":4.383,"5min":4.383,"15min":4.383},"last":1.561},{"interface":"front","average":{"1min":1.561,"5min":1.561,"15min":1.561},"min":{"1min":0.823,"5min":0.823,"15min":0.823},"max":{"1min":2.829,"5min":2.829,"15min":2.829},"last":1.251}]},{"osd":8,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.988,"15min":1.988},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":5.958,"5min":5.958,"15min":5.958},"last":1.526},{"interface":"front","average":{"1min":10.214,"5min":10.214,"15min":10.214},"min":{"1min":0.935,"5min":0.935,"15min":0.935},"max":{"1min":137.259,"5min":137.259,"15min":137.259},"last":1.426}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":1.766,"15min":1.766},"min":{"1min":1.228,"5min":1.228,"15min":1.228},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.741},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":2.753,"5min":2.753,"15min":2.753},"last":1.388}]}]},{"osd":8,"up_from":47,"seq":201863462943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.914,"5min":0.927,"15min":0.929},"min":{"1min":0.516,"5min":0.471,"15min":0.471},"max":{"1min":1.450,"5min":1.640,"15min":1.640},"last":0.728},{"interface":"front","average":{"1min":0.960,"5min":0.924,"15min":0.918},"min":{"1min":0.527,"5min":0.527,"15min":0.527},"max":{"1min":1.607,"5min":1.841,"15min":1.841},"last":0.828}]},{"osd":1,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":15.598,"5min":27.074,"15min":28.987},"min":{"1min":0.686,"5min":0.556,"15min":0.556},"max":{"1min":291.598,"5min":503.201,"15min":503.201},"last":1.173},{"interface":"front","average":{"1min":1.076,"5min":23.305,"15min":27.010},"min":{"1min":0.473,"5min":0.451,"15min":0.451},"max":{"1min":1.652,"5min":502.942,"15min":502.942},"last":0.960}]},{"osd":2,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.900,"5min":0.972,"15min":0.984},"min":{"1min":0.470,"5min":0.470,"15min":0.470},"max":{"1min":1.506,"5min":1.620,"15min":1.620},"last":0.894},{"interface":"front","average":{"1min":1.076,"5min":1.200,"15min":1.221},"min":{"1min":0.583,"5min":0.550,"15min":0.550},"max":{"1min":1.833,"5min":4.085,"15min":4.085},"last":0.769}]},{"osd":3,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.118,"5min":1.210,"15min":1.225},"min":{"1min":0.657,"5min":0.657,"15min":0.657},"max":{"1min":2.076,"5min":2.106,"15min":2.106},"last":0.808},{"interface":"front","average":{"1min":1.038,"5min":1.138,"15min":1.154},"min":{"1min":0.598,"5min":0.598,"15min":0.598},"max":{"1min":1.590,"5min":2.000,"15min":2.000},"last":1.014}]},{"osd":4,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.215,"5min":1.231,"15min":1.233},"min":{"1min":0.685,"5min":0.661,"15min":0.661},"max":{"1min":1.876,"5min":2.171,"15min":2.171},"last":1.401},{"interface":"front","average":{"1min":46.986,"5min":10.675,"15min":4.623},"min":{"1min":0.648,"5min":0.648,"15min":0.648},"max":{"1min":965.121,"5min":965.121,"15min":965.121},"last":1.072}]},{"osd":5,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.398,"5min":1.592,"15min":1.624},"min":{"1min":0.765,"5min":0.765,"15min":0.765},"max":{"1min":1.897,"5min":4.220,"15min":4.220},"last":1.335},{"interface":"front","average":{"1min":1.379,"5min":1.441,"15min":1.451},"min":{"1min":0.807,"5min":0.677,"15min":0.677},"max":{"1min":1.805,"5min":2.262,"15min":2.262},"last":1.258}]},{"osd":6,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.527,"15min":1.594},"min":{"1min":0.645,"5min":0.645,"15min":0.645},"max":{"1min":1.798,"5min":8.757,"15min":8.757},"last":1.209},{"interface":"front","average":{"1min":4.965,"5min":2.294,"15min":1.849},"min":{"1min":0.719,"5min":0.719,"15min":0.719},"max":{"1min":77.942,"5min":77.942,"15min":77.942},"last":1.140}]},{"osd":7,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.476,"15min":1.474},"min":{"1min":1.200,"5min":0.950,"15min":0.950},"max":{"1min":2.124,"5min":2.409,"15min":2.409},"last":591.738},{"interface":"front","average":{"1min":1.610,"5min":1.902,"15min":1.951},"min":{"1min":1.296,"5min":0.984,"15min":0.984},"max":{"1min":2.329,"5min":8.832,"15min":8.832},"last":1.462}]},{"osd":9,"last update":"Sun Dec 22 22:30:10 2019","interfaces":[{"interface":"back","average":{"1min":1.612,"5min":1.612,"15min":1.612},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":2.528,"5min":2.528,"15min":2.528},"last":1.500},{"interface":"front","average":{"1min":1.392,"5min":1.392,"15min":1.392},"min":{"1min":0.769,"5min":0.769,"15min":0.769},"max":{"1min":2.219,"5min":2.219,"15min":2.219},"last":1.433}]},{"osd":10,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.740,"5min":0.740,"15min":0.740},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.369},{"interface":"front","average":{"1min":1.616,"5min":1.616,"15min":1.616},"min":{"1min":1.010,"5min":1.010,"15min":1.010},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.534}]}]},{"osd":7,"up_from":42,"seq":180388626467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.114,"15min":1.124},"min":{"1min":0.720,"5min":0.605,"15min":0.605},"max":{"1min":1.383,"5min":1.864,"15min":1.864},"last":0.980},{"interface":"front","average":{"1min":1.190,"5min":1.127,"15min":1.117},"min":{"1min":0.714,"5min":0.707,"15min":0.707},"max":{"1min":1.578,"5min":1.594,"15min":1.594},"last":0.845}]},{"osd":1,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":51.076,"5min":11.162,"15min":4.510},"min":{"1min":0.656,"5min":0.656,"15min":0.656},"max":{"1min":851.679,"5min":851.679,"15min":851.679},"last":0.727},{"interface":"front","average":{"1min":1.072,"5min":1.038,"15min":1.032},"min":{"1min":0.615,"5min":0.615,"15min":0.615},"max":{"1min":1.505,"5min":1.637,"15min":1.637},"last":1.141}]},{"osd":2,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.024,"15min":1.029},"min":{"1min":0.652,"5min":0.652,"15min":0.652},"max":{"1min":1.369,"5min":1.565,"15min":1.565},"last":1.254},{"interface":"front","average":{"1min":1.071,"5min":23.176,"15min":26.860},"min":{"1min":0.695,"5min":0.685,"15min":0.685},"max":{"1min":1.436,"5min":579.355,"15min":579.355},"last":1.534}]},{"osd":3,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":35.627,"5min":8.027,"15min":3.427},"min":{"1min":0.702,"5min":0.668,"15min":0.668},"max":{"1min":588.429,"5min":588.429,"15min":588.429},"last":1.196},{"interface":"front","average":{"1min":1.047,"5min":2.209,"15min":2.403},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.362,"5min":28.026,"15min":28.026},"last":1.082}]},{"osd":4,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.074,"5min":1.039,"15min":1.033},"min":{"1min":0.813,"5min":0.546,"15min":0.546},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.491},{"interface":"front","average":{"1min":1.067,"5min":1.035,"15min":1.029},"min":{"1min":0.563,"5min":0.563,"15min":0.563},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.288}]},{"osd":5,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.223,"5min":1.308,"15min":1.322},"min":{"1min":0.648,"5min":0.648,"15min":0.648},"max":{"1min":1.701,"5min":2.001,"15min":2.001},"last":1.439},{"interface":"front","average":{"1min":1.363,"5min":9.607,"15min":10.981},"min":{"1min":1.005,"5min":1.005,"15min":1.005},"max":{"1min":1.657,"5min":217.508,"15min":217.508},"last":1.365}]},{"osd":6,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.366,"5min":1.353,"15min":1.351},"min":{"1min":0.856,"5min":0.856,"15min":0.856},"max":{"1min":1.621,"5min":1.943,"15min":1.943},"last":1.402},{"interface":"front","average":{"1min":1.229,"5min":1.258,"15min":1.263},"min":{"1min":0.836,"5min":0.696,"15min":0.696},"max":{"1min":1.607,"5min":1.749,"15min":1.749},"last":1.312}]},{"osd":8,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.473,"5min":1.517,"15min":1.524},"min":{"1min":0.903,"5min":0.903,"15min":0.903},"max":{"1min":1.882,"5min":1.883,"15min":1.883},"last":1.635},{"interface":"front","average":{"1min":56.141,"5min":12.489,"15min":5.213},"min":{"1min":1.313,"5min":1.313,"15min":1.313},"max":{"1min":929.400,"5min":929.400,"15min":929.400},"last":1.601}]},{"osd":9,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.578,"5min":1.578,"15min":1.578},"min":{"1min":1.170,"5min":1.170,"15min":1.170},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.738},{"interface":"front","average":{"1min":1.651,"5min":1.651,"15min":1.651},"min":{"1min":1.501,"5min":1.501,"15min":1.501},"max":{"1min":1.892,"5min":1.892,"15min":1.892},"last":1.688}]},{"osd":10,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.604,"5min":1.604,"15min":1.604},"min":{"1min":1.199,"5min":1.199,"15min":1.199},"max":{"1min":1.951,"5min":1.951,"15min":1.951},"last":1.827},{"interface":"front","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.441,"5min":1.441,"15min":1.441},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.791}]}]},{"osd":6,"up_from":37,"seq":158913789990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.193,"15min":1.197},"min":{"1min":0.644,"5min":0.644,"15min":0.644},"max":{"1min":1.736,"5min":1.877,"15min":1.877},"last":1.646},{"interface":"front","average":{"1min":1.027,"5min":1.040,"15min":1.042},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.353,"5min":1.905,"15min":1.905},"last":1.281}]},{"osd":1,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.199,"5min":1.020,"15min":0.990},"min":{"1min":0.710,"5min":0.656,"15min":0.656},"max":{"1min":2.130,"5min":2.130,"15min":2.130},"last":0.621},{"interface":"front","average":{"1min":11.192,"5min":3.035,"15min":1.675},"min":{"1min":0.554,"5min":0.554,"15min":0.554},"max":{"1min":215.806,"5min":215.806,"15min":215.806},"last":1.098}]},{"osd":2,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.007,"5min":47.014,"15min":54.682},"min":{"1min":0.691,"5min":0.673,"15min":0.673},"max":{"1min":1.697,"5min":786.128,"15min":786.128},"last":892.790},{"interface":"front","average":{"1min":1.107,"5min":1.096,"15min":1.094},"min":{"1min":0.727,"5min":0.622,"15min":0.622},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.559}]},{"osd":3,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":0.950,"5min":1.008,"15min":1.018},"min":{"1min":0.610,"5min":0.610,"15min":0.610},"max":{"1min":1.517,"5min":1.772,"15min":1.772},"last":1.156},{"interface":"front","average":{"1min":1.061,"5min":1.040,"15min":1.036},"min":{"1min":0.682,"5min":0.682,"15min":0.682},"max":{"1min":1.628,"5min":1.628,"15min":1.628},"last":1.065}]},{"osd":4,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.009,"15min":1.003},"min":{"1min":0.640,"5min":0.544,"15min":0.544},"max":{"1min":1.656,"5min":1.920,"15min":1.920},"last":1.393},{"interface":"front","average":{"1min":1.069,"5min":0.993,"15min":0.980},"min":{"1min":0.702,"5min":0.540,"15min":0.540},"max":{"1min":1.572,"5min":1.683,"15min":1.683},"last":0.993}]},{"osd":5,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.229,"5min":1.232,"15min":1.232},"min":{"1min":0.602,"5min":0.602,"15min":0.602},"max":{"1min":1.531,"5min":2.279,"15min":2.279},"last":1.446},{"interface":"front","average":{"1min":1.443,"5min":1.478,"15min":1.484},"min":{"1min":0.958,"5min":0.958,"15min":0.958},"max":{"1min":2.034,"5min":4.535,"15min":4.535},"last":1.738}]},{"osd":7,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.435,"5min":1.350,"15min":1.336},"min":{"1min":0.638,"5min":0.638,"15min":0.638},"max":{"1min":1.963,"5min":1.963,"15min":1.963},"last":1.700},{"interface":"front","average":{"1min":1.242,"5min":1.248,"15min":1.249},"min":{"1min":0.834,"5min":0.834,"15min":0.834},"max":{"1min":1.780,"5min":1.780,"15min":1.780},"last":1.220}]},{"osd":8,"last update":"Sun Dec 22 22:30:51 2019","interfaces":[{"interface":"back","average":{"1min":43.697,"5min":9.814,"15min":4.167},"min":{"1min":0.940,"5min":0.873,"15min":0.873},"max":{"1min":449.604,"5min":449.604,"15min":449.604},"last":1.325},{"interface":"front","average":{"1min":30.044,"5min":7.260,"15min":3.462},"min":{"1min":1.353,"5min":1.272,"15min":1.272},"max":{"1min":596.398,"5min":596.398,"15min":596.398},"last":1.962}]},{"osd":9,"last update":"Sun Dec 22 22:30:07 2019","interfaces":[{"interface":"back","average":{"1min":1.695,"5min":1.695,"15min":1.695},"min":{"1min":1.340,"5min":1.340,"15min":1.340},"max":{"1min":2.784,"5min":2.784,"15min":2.784},"last":1.924},{"interface":"front","average":{"1min":1.459,"5min":1.459,"15min":1.459},"min":{"1min":1.057,"5min":1.057,"15min":1.057},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.604}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.533,"15min":1.533},"min":{"1min":1.188,"5min":1.188,"15min":1.188},"max":{"1min":2.030,"5min":2.030,"15min":2.030},"last":1.527},{"interface":"front","average":{"1min":14.761,"5min":14.761,"15min":14.761},"min":{"1min":1.040,"5min":1.040,"15min":1.040},"max":{"1min":279.809,"5min":279.809,"15min":279.809},"last":1.471}]}]},{"osd":1,"up_from":12,"seq":51539607610,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":0.799,"5min":4.913,"15min":1.997},"min":{"1min":0.481,"5min":0.301,"15min":0.301},"max":{"1min":2.181,"5min":447.710,"15min":447.710},"last":0.923},{"interface":"front","average":{"1min":31.591,"5min":6.856,"15min":2.701},"min":{"1min":0.520,"5min":0.337,"15min":0.337},"max":{"1min":522.718,"5min":522.718,"15min":522.718},"last":0.620}]},{"osd":2,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":0.868,"5min":0.749,"15min":0.698},"min":{"1min":0.582,"5min":0.431,"15min":0.431},"max":{"1min":1.490,"5min":1.490,"15min":1.490},"last":0.782},{"interface":"front","average":{"1min":0.860,"5min":0.746,"15min":0.701},"min":{"1min":0.515,"5min":0.496,"15min":0.496},"max":{"1min":1.336,"5min":1.336,"15min":1.336},"last":0.663}]},{"osd":3,"last update":"Sun Dec 22 22:30:20 2019","interfaces":[{"interface":"back","average":{"1min":0.850,"5min":0.789,"15min":0.771},"min":{"1min":0.534,"5min":0.534,"15min":0.534},"max":{"1min":1.428,"5min":1.428,"15min":1.428},"last":1.049},{"interface":"front","average":{"1min":0.991,"5min":7.186,"15min":3.012},"min":{"1min":0.723,"5min":0.691,"15min":0.691},"max":{"1min":1.316,"5min":686.743,"15min":686.743},"last":1.309}]},{"osd":4,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":1.008,"15min":0.979},"min":{"1min":0.750,"5min":0.488,"15min":0.488},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.081},{"interface":"front","average":{"1min":51.506,"5min":11.073,"15min":4.301},"min":{"1min":0.765,"5min":0.710,"15min":0.710},"max":{"1min":856.751,"5min":856.751,"15min":856.751},"last":1.198}]},{"osd":5,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":1.257,"5min":1.102,"15min":1.053},"min":{"1min":0.657,"5min":0.657,"15min":0.657},"max":{"1min":2.315,"5min":2.315,"15min":2.315},"last":1.160},{"interface":"front","average":{"1min":1.255,"5min":1.143,"15min":1.107},"min":{"1min":0.931,"5min":0.768,"15min":0.768},"max":{"1min":1.822,"5min":1.822,"15min":1.822},"last":1.351}]},{"osd":6,"last update":"Sun Dec 22 22:30:10 2019","interfaces":[{"interface":"back","average":{"1min":20.627,"5min":5.019,"15min":2.417},"min":{"1min":0.795,"5min":0.678,"15min":0.678},"max":{"1min":350.575,"5min":350.575,"15min":350.575},"last":1.119},{"interface":"front","average":{"1min":1.292,"5min":1.183,"15min":1.165},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.022,"5min":2.022,"15min":2.022},"last":1.388}]},{"osd":7,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":50.092,"5min":11.052,"15min":4.546},"min":{"1min":0.661,"5min":0.661,"15min":0.661},"max":{"1min":830.970,"5min":830.970,"15min":830.970},"last":1.438},{"interface":"front","average":{"1min":1.229,"5min":1.322,"15min":1.338},"min":{"1min":0.868,"5min":0.868,"15min":0.868},"max":{"1min":1.679,"5min":2.080,"15min":2.080},"last":1.529}]},{"osd":8,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":31.817,"5min":58.579,"15min":63.039},"min":{"1min":0.990,"5min":0.894,"15min":0.894},"max":{"1min":487.747,"5min":993.474,"15min":993.474},"last":1.490},{"interface":"front","average":{"1min":34.569,"5min":8.068,"15min":3.651},"min":{"1min":1.040,"5min":1.040,"15min":1.040},"max":{"1min":532.136,"5min":532.136,"15min":532.136},"last":1.465}]},{"osd":9,"last update":"Sun Dec 22 22:30:10 2019","interfaces":[{"interface":"back","average":{"1min":39.121,"5min":39.121,"15min":39.121},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":715.827,"5min":715.827,"15min":715.827},"last":1.585},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.255}]},{"osd":10,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.102,"5min":2.102,"15min":2.102},"last":1.639},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":1.213,"5min":1.213,"15min":1.213},"max":{"1min":2.140,"5min":2.140,"15min":2.140},"last":1.676}]}]},{"osd":0,"up_from":7,"seq":30064771135,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":0.792,"5min":1.323,"15min":0.793},"min":{"1min":0.493,"5min":0.346,"15min":0.346},"max":{"1min":1.382,"5min":68.607,"15min":68.607},"last":0.686},{"interface":"front","average":{"1min":19.114,"5min":4.388,"15min":1.857},"min":{"1min":0.583,"5min":0.404,"15min":0.404},"max":{"1min":381.781,"5min":381.781,"15min":381.781},"last":0.615}]},{"osd":2,"last update":"Sun Dec 22 22:28:51 2019","interfaces":[{"interface":"back","average":{"1min":23.953,"5min":5.351,"15min":2.251},"min":{"1min":0.488,"5min":0.444,"15min":0.444},"max":{"1min":501.694,"5min":501.694,"15min":501.694},"last":1.446},{"interface":"front","average":{"1min":22.535,"5min":5.030,"15min":2.112},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":501.287,"5min":501.287,"15min":501.287},"last":0.805}]},{"osd":3,"last update":"Sun Dec 22 22:30:15 2019","interfaces":[{"interface":"back","average":{"1min":0.912,"5min":0.755,"15min":0.696},"min":{"1min":0.593,"5min":0.523,"15min":0.523},"max":{"1min":1.483,"5min":1.483,"15min":1.483},"last":0.852},{"interface":"front","average":{"1min":31.437,"5min":6.969,"15min":2.875},"min":{"1min":0.564,"5min":0.564,"15min":0.564},"max":{"1min":548.602,"5min":548.602,"15min":548.602},"last":0.573}]},{"osd":4,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":1.130,"5min":1.103,"15min":1.091},"min":{"1min":0.787,"5min":0.680,"15min":0.680},"max":{"1min":1.773,"5min":2.152,"15min":2.152},"last":0.730},{"interface":"front","average":{"1min":1.056,"5min":16.051,"15min":6.020},"min":{"1min":0.723,"5min":0.723,"15min":0.723},"max":{"1min":1.526,"5min":995.256,"15min":995.256},"last":0.801}]},{"osd":5,"last update":"Sun Dec 22 22:30:56 2019","interfaces":[{"interface":"back","average":{"1min":1.290,"5min":1.155,"15min":1.111},"min":{"1min":0.864,"5min":0.819,"15min":0.819},"max":{"1min":1.933,"5min":1.933,"15min":1.933},"last":0.987},{"interface":"front","average":{"1min":35.092,"5min":7.988,"15min":3.436},"min":{"1min":0.793,"5min":0.671,"15min":0.671},"max":{"1min":677.586,"5min":677.586,"15min":677.586},"last":1.019}]},{"osd":6,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.364,"5min":1.238,"15min":1.217},"min":{"1min":0.733,"5min":0.709,"15min":0.709},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":0.760},{"interface":"front","average":{"1min":1.261,"5min":1.236,"15min":1.232},"min":{"1min":0.805,"5min":0.805,"15min":0.805},"max":{"1min":1.733,"5min":1.733,"15min":1.733},"last":0.956}]},{"osd":7,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.324,"5min":1.251,"15min":1.239},"min":{"1min":0.891,"5min":0.827,"15min":0.827},"max":{"1min":1.935,"5min":1.935,"15min":1.935},"last":1.164},{"interface":"front","average":{"1min":1.424,"5min":1.290,"15min":1.268},"min":{"1min":1.002,"5min":0.957,"15min":0.957},"max":{"1min":2.098,"5min":2.098,"15min":2.098},"last":1.076}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.553,"5min":1.544,"15min":1.542},"min":{"1min":1.185,"5min":0.964,"15min":0.964},"max":{"1min":2.131,"5min":2.341,"15min":2.341},"last":0.916},{"interface":"front","average":{"1min":1.462,"5min":1.435,"15min":1.431},"min":{"1min":0.856,"5min":0.856,"15min":0.856},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1.315}]},{"osd":9,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.592,"5min":1.592,"15min":1.592},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.050},{"interface":"front","average":{"1min":1.483,"5min":1.483,"15min":1.483},"min":{"1min":0.974,"5min":0.974,"15min":0.974},"max":{"1min":2.280,"5min":2.280,"15min":2.280},"last":1.110}]},{"osd":10,"last update":"Sun Dec 22 22:30:28 2019","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":2.408,"5min":2.408,"15min":2.408},"last":1.196},{"interface":"front","average":{"1min":1.477,"5min":1.477,"15min":1.477},"min":{"1min":0.889,"5min":0.889,"15min":0.889},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.236}]},{"osd":11,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":23.924,"5min":23.924,"15min":23.924},"min":{"1min":1.013,"5min":1.013,"15min":1.013},"max":{"1min":467.930,"5min":467.930,"15min":467.930},"last":1.139},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":1.242,"5min":1.242,"15min":1.242},"max":{"1min":2.114,"5min":2.114,"15min":2.114},"last":1.275}]}]},{"osd":2,"up_from":17,"seq":73014444085,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":0.884,"5min":0.707,"15min":0.617},"min":{"1min":0.411,"5min":0.411,"15min":0.411},"max":{"1min":1.677,"5min":1.863,"15min":1.863},"last":1.115},{"interface":"front","average":{"1min":0.934,"5min":3.822,"15min":1.704},"min":{"1min":0.539,"5min":0.315,"15min":0.315},"max":{"1min":1.642,"5min":272.186,"15min":272.186},"last":0.968}]},{"osd":1,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":0.953,"5min":4.723,"15min":1.993},"min":{"1min":0.438,"5min":0.391,"15min":0.391},"max":{"1min":1.821,"5min":357.558,"15min":357.558},"last":1.284},{"interface":"front","average":{"1min":0.953,"5min":0.834,"15min":0.716},"min":{"1min":0.492,"5min":0.390,"15min":0.390},"max":{"1min":2.259,"5min":2.259,"15min":2.259},"last":1.185}]},{"osd":3,"last update":"Sun Dec 22 22:30:15 2019","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.901,"15min":0.868},"min":{"1min":0.602,"5min":0.602,"15min":0.602},"max":{"1min":2.182,"5min":2.182,"15min":2.182},"last":0.846},{"interface":"front","average":{"1min":0.841,"5min":0.748,"15min":0.705},"min":{"1min":0.484,"5min":0.484,"15min":0.484},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.225}]},{"osd":4,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.122,"5min":1.053,"15min":1.031},"min":{"1min":0.666,"5min":0.666,"15min":0.666},"max":{"1min":2.111,"5min":2.111,"15min":2.111},"last":0.714},{"interface":"front","average":{"1min":1.253,"5min":1.062,"15min":1.018},"min":{"1min":0.931,"5min":0.664,"15min":0.664},"max":{"1min":2.045,"5min":2.045,"15min":2.045},"last":1.435}]},{"osd":5,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":50.784,"5min":13.329,"15min":7.725},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":944.730,"5min":944.730,"15min":944.730},"last":1.022},{"interface":"front","average":{"1min":1.290,"5min":1.148,"15min":1.106},"min":{"1min":0.671,"5min":0.671,"15min":0.671},"max":{"1min":2.526,"5min":2.526,"15min":2.526},"last":1.623}]},{"osd":6,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.311,"5min":1.255,"15min":1.246},"min":{"1min":0.743,"5min":0.743,"15min":0.743},"max":{"1min":2.381,"5min":2.381,"15min":2.381},"last":1.346},{"interface":"front","average":{"1min":1.259,"5min":1.252,"15min":1.251},"min":{"1min":0.867,"5min":0.797,"15min":0.797},"max":{"1min":2.467,"5min":2.467,"15min":2.467},"last":0.757}]},{"osd":7,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.487,"5min":1.336,"15min":1.311},"min":{"1min":0.860,"5min":0.860,"15min":0.860},"max":{"1min":2.811,"5min":2.811,"15min":2.811},"last":1.667},{"interface":"front","average":{"1min":1.588,"5min":17.128,"15min":19.718},"min":{"1min":1.030,"5min":1.030,"15min":1.030},"max":{"1min":2.874,"5min":412.794,"15min":412.794},"last":1.771}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.382,"5min":1.450,"15min":1.461},"min":{"1min":0.632,"5min":0.632,"15min":0.632},"max":{"1min":2.672,"5min":2.672,"15min":2.672},"last":1.399},{"interface":"front","average":{"1min":1.487,"5min":1.378,"15min":1.360},"min":{"1min":0.690,"5min":0.690,"15min":0.690},"max":{"1min":2.420,"5min":2.420,"15min":2.420},"last":1.736}]},{"osd":9,"last update":"Sun Dec 22 22:30:08 2019","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.890,"5min":0.890,"15min":0.890},"max":{"1min":2.757,"5min":2.757,"15min":2.757},"last":1.471},{"interface":"front","average":{"1min":1.530,"5min":1.530,"15min":1.530},"min":{"1min":1.045,"5min":1.045,"15min":1.045},"max":{"1min":2.619,"5min":2.619,"15min":2.619},"last":1.703}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":54.553,"5min":54.553,"15min":54.553},"min":{"1min":1.147,"5min":1.147,"15min":1.147},"max":{"1min":501.863,"5min":501.863,"15min":501.863},"last":1.522},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.704,"5min":2.704,"15min":2.704},"last":449.841}]}]},{"osd":3,"up_from":22,"seq":94489280563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049196,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92695956,"statfs":{"total":95995035648,"available":94920658944,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:29:14 2019","interfaces":[{"interface":"back","average":{"1min":0.843,"5min":0.692,"15min":0.667},"min":{"1min":0.625,"5min":0.474,"15min":0.474},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.609},{"interface":"front","average":{"1min":0.867,"5min":0.742,"15min":0.721},"min":{"1min":0.556,"5min":0.527,"15min":0.527},"max":{"1min":1.555,"5min":1.555,"15min":1.555},"last":0.707}]},{"osd":1,"last update":"Sun Dec 22 22:30:18 2019","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.797,"15min":0.784},"min":{"1min":0.415,"5min":0.415,"15min":0.415},"max":{"1min":1.527,"5min":1.527,"15min":1.527},"last":0.989},{"interface":"front","average":{"1min":0.922,"5min":5.827,"15min":2.559},"min":{"1min":0.511,"5min":0.511,"15min":0.511},"max":{"1min":3.372,"5min":467.732,"15min":467.732},"last":1.199}]},{"osd":2,"last update":"Sun Dec 22 22:30:18 2019","interfaces":[{"interface":"back","average":{"1min":29.972,"5min":6.561,"15min":2.632},"min":{"1min":0.485,"5min":0.485,"15min":0.485},"max":{"1min":667.845,"5min":667.845,"15min":667.845},"last":1.486},{"interface":"front","average":{"1min":0.948,"5min":0.829,"15min":0.776},"min":{"1min":0.523,"5min":0.455,"15min":0.455},"max":{"1min":1.940,"5min":1.940,"15min":1.940},"last":0.761}]},{"osd":4,"last update":"Sun Dec 22 22:30:37 2019","interfaces":[{"interface":"back","average":{"1min":1.265,"5min":1.121,"15min":1.067},"min":{"1min":0.772,"5min":0.652,"15min":0.652},"max":{"1min":2.961,"5min":2.961,"15min":2.961},"last":1.419},{"interface":"front","average":{"1min":1.312,"5min":1.158,"15min":1.102},"min":{"1min":0.886,"5min":0.750,"15min":0.750},"max":{"1min":2.845,"5min":2.845,"15min":2.845},"last":1.680}]},{"osd":5,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.974,"5min":1.756,"15min":1.998},"min":{"1min":0.609,"5min":0.609,"15min":0.609},"max":{"1min":1.561,"5min":24.295,"15min":24.295},"last":1.303},{"interface":"front","average":{"1min":1.131,"5min":1.160,"15min":1.118},"min":{"1min":0.776,"5min":0.776,"15min":0.776},"max":{"1min":1.786,"5min":2.312,"15min":2.312},"last":1.589}]},{"osd":6,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":36.679,"5min":8.283,"15min":3.551},"min":{"1min":0.850,"5min":0.850,"15min":0.850},"max":{"1min":501.935,"5min":501.935,"15min":501.935},"last":1.088},{"interface":"front","average":{"1min":1.414,"5min":1.308,"15min":1.290},"min":{"1min":0.647,"5min":0.647,"15min":0.647},"max":{"1min":2.155,"5min":2.155,"15min":2.155},"last":1.145}]},{"osd":7,"last update":"Sun Dec 22 22:30:37 2019","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.387,"15min":1.393},"min":{"1min":0.804,"5min":0.804,"15min":0.804},"max":{"1min":3.156,"5min":3.156,"15min":3.156},"last":1.841},{"interface":"front","average":{"1min":1.261,"5min":1.340,"15min":1.353},"min":{"1min":0.650,"5min":0.650,"15min":0.650},"max":{"1min":2.523,"5min":2.523,"15min":2.523},"last":1.257}]},{"osd":8,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.320,"5min":34.304,"15min":39.801},"min":{"1min":0.811,"5min":0.811,"15min":0.811},"max":{"1min":1.970,"5min":820.143,"15min":820.143},"last":1.726},{"interface":"front","average":{"1min":15.298,"5min":4.367,"15min":2.545},"min":{"1min":0.840,"5min":0.840,"15min":0.840},"max":{"1min":292.729,"5min":292.729,"15min":292.729},"last":1.933}]},{"osd":9,"last update":"Sun Dec 22 22:30:09 2019","interfaces":[{"interface":"back","average":{"1min":1.620,"5min":1.620,"15min":1.620},"min":{"1min":1.144,"5min":1.144,"15min":1.144},"max":{"1min":2.592,"5min":2.592,"15min":2.592},"last":1.903},{"interface":"front","average":{"1min":1.600,"5min":1.600,"15min":1.600},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":3.233,"5min":3.233,"15min":3.233},"last":1.642}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":15.340,"5min":15.340,"15min":15.340},"min":{"1min":0.821,"5min":0.821,"15min":0.821},"max":{"1min":280.174,"5min":280.174,"15min":280.174},"last":1.387},{"interface":"front","average":{"1min":43.049,"5min":43.049,"15min":43.049},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":832.650,"5min":832.650,"15min":832.650},"last":1.521}]},{"osd":11,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":20.768,"5min":20.768,"15min":20.768},"min":{"1min":0.910,"5min":0.910,"15min":0.910},"max":{"1min":427.022,"5min":427.022,"15min":427.022},"last":1.790},{"interface":"front","average":{"1min":37.520,"5min":37.520,"15min":37.520},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":792.516,"5min":792.516,"15min":792.516},"last":1.872}]}]},{"osd":4,"up_from":27,"seq":115964117037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.055,"5min":1.073,"15min":1.069},"min":{"1min":0.652,"5min":0.649,"15min":0.649},"max":{"1min":1.479,"5min":1.942,"15min":1.942},"last":1.007},{"interface":"front","average":{"1min":1.173,"5min":1.107,"15min":1.098},"min":{"1min":0.824,"5min":0.721,"15min":0.721},"max":{"1min":1.620,"5min":1.876,"15min":1.876},"last":0.821}]},{"osd":1,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":0.977,"5min":0.935,"15min":0.905},"min":{"1min":0.603,"5min":0.580,"15min":0.580},"max":{"1min":1.453,"5min":1.546,"15min":1.546},"last":0.594},{"interface":"front","average":{"1min":1.038,"5min":3.901,"15min":1.927},"min":{"1min":0.678,"5min":0.629,"15min":0.629},"max":{"1min":1.547,"5min":277.064,"15min":277.064},"last":0.854}]},{"osd":2,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":15.435,"15min":21.785},"min":{"1min":0.827,"5min":0.757,"15min":0.757},"max":{"1min":1.636,"5min":430.289,"15min":430.289},"last":1.383},{"interface":"front","average":{"1min":37.352,"5min":18.552,"15min":6.938},"min":{"1min":0.926,"5min":0.743,"15min":0.743},"max":{"1min":831.842,"5min":967.982,"15min":967.982},"last":1.441}]},{"osd":3,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":1.050,"15min":1.015},"min":{"1min":0.762,"5min":0.585,"15min":0.585},"max":{"1min":1.521,"5min":1.728,"15min":1.728},"last":1.085},{"interface":"front","average":{"1min":1.029,"5min":10.775,"15min":4.207},"min":{"1min":0.670,"5min":0.636,"15min":0.636},"max":{"1min":1.518,"5min":929.402,"15min":929.402},"last":0.932}]},{"osd":5,"last update":"Sun Dec 22 22:30:56 2019","interfaces":[{"interface":"back","average":{"1min":1.140,"5min":1.002,"15min":0.962},"min":{"1min":0.713,"5min":0.509,"15min":0.509},"max":{"1min":1.563,"5min":1.905,"15min":1.905},"last":0.718},{"interface":"front","average":{"1min":1.331,"5min":1.114,"15min":1.056},"min":{"1min":0.613,"5min":0.484,"15min":0.484},"max":{"1min":1.683,"5min":1.683,"15min":1.683},"last":1.486}]},{"osd":6,"last update":"Sun Dec 22 22:30:16 2019","interfaces":[{"interface":"back","average":{"1min":84.896,"5min":17.852,"15min":6.678},"min":{"1min":0.782,"5min":0.680,"15min":0.680},"max":{"1min":529.309,"5min":529.309,"15min":529.309},"last":0.967},{"interface":"front","average":{"1min":1.195,"5min":1.243,"15min":1.251},"min":{"1min":0.825,"5min":0.600,"15min":0.600},"max":{"1min":1.645,"5min":1.707,"15min":1.707},"last":0.785}]},{"osd":7,"last update":"Sun Dec 22 22:30:34 2019","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.259,"15min":1.247},"min":{"1min":0.783,"5min":0.623,"15min":0.623},"max":{"1min":1.678,"5min":1.678,"15min":1.678},"last":0.757},{"interface":"front","average":{"1min":1.228,"5min":1.299,"15min":1.311},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.721,"5min":1.721,"15min":1.721},"last":1.300}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.430,"5min":26.380,"15min":30.538},"min":{"1min":1.150,"5min":1.111,"15min":1.111},"max":{"1min":1.814,"5min":531.221,"15min":531.221},"last":1.577},{"interface":"front","average":{"1min":1.648,"5min":1.518,"15min":1.496},"min":{"1min":1.275,"5min":0.951,"15min":0.951},"max":{"1min":1.932,"5min":1.932,"15min":1.932},"last":1.515}]},{"osd":9,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":1.590,"5min":1.590,"15min":1.590},"min":{"1min":0.977,"5min":0.977,"15min":0.977},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.540},{"interface":"front","average":{"1min":51.652,"5min":51.652,"15min":51.652},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":904.459,"5min":904.459,"15min":904.459},"last":1.405}]},{"osd":10,"last update":"Sun Dec 22 22:30:28 2019","interfaces":[{"interface":"back","average":{"1min":14.077,"5min":14.077,"15min":14.077},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":275.538,"5min":275.538,"15min":275.538},"last":1.404},{"interface":"front","average":{"1min":1.658,"5min":1.658,"15min":1.658},"min":{"1min":1.020,"5min":1.020,"15min":1.020},"max":{"1min":1.951,"5min":1.951,"15min":1.951},"last":1.972}]}]},{"osd":5,"up_from":32,"seq":137438953514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049108,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696044,"statfs":{"total":95995035648,"available":94920749056,"internally_reserved":1073741824,"allocated":536576,"data_stored":231694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":5.148,"5min":1.819,"15min":1.260},"min":{"1min":0.760,"5min":0.568,"15min":0.568},"max":{"1min":75.068,"5min":75.068,"15min":75.068},"last":0.717},{"interface":"front","average":{"1min":1.262,"5min":1.041,"15min":0.969},"min":{"1min":0.680,"5min":0.630,"15min":0.630},"max":{"1min":5.292,"5min":5.292,"15min":5.292},"last":1.186}]},{"osd":1,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.259,"5min":24.901,"15min":35.449},"min":{"1min":0.780,"5min":0.453,"15min":0.453},"max":{"1min":5.195,"5min":637.713,"15min":637.713},"last":0.864},{"interface":"front","average":{"1min":1.231,"5min":1.080,"15min":1.043},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":5.080,"5min":5.080,"15min":5.080},"last":0.910}]},{"osd":2,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.328,"5min":1.015,"15min":0.943},"min":{"1min":0.759,"5min":0.526,"15min":0.526},"max":{"1min":5.239,"5min":5.239,"15min":5.239},"last":1.326},{"interface":"front","average":{"1min":48.970,"5min":10.645,"15min":4.233},"min":{"1min":0.614,"5min":0.614,"15min":0.614},"max":{"1min":906.443,"5min":906.443,"15min":906.443},"last":1.011}]},{"osd":3,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":32.944,"5min":7.425,"15min":3.155},"min":{"1min":0.684,"5min":0.544,"15min":0.544},"max":{"1min":601.608,"5min":601.608,"15min":601.608},"last":0.963},{"interface":"front","average":{"1min":1.403,"5min":1.143,"15min":1.075},"min":{"1min":0.733,"5min":0.581,"15min":0.581},"max":{"1min":5.351,"5min":5.351,"15min":5.351},"last":1.270}]},{"osd":4,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.059,"5min":5.945,"15min":2.619},"min":{"1min":0.575,"5min":0.426,"15min":0.426},"max":{"1min":2.019,"5min":447.758,"15min":447.758},"last":1.377},{"interface":"front","average":{"1min":1.242,"5min":1.117,"15min":1.061},"min":{"1min":0.766,"5min":0.368,"15min":0.368},"max":{"1min":1.561,"5min":1.862,"15min":1.862},"last":1.547}]},{"osd":6,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":1.285,"5min":1.114,"15min":1.086},"min":{"1min":0.825,"5min":0.336,"15min":0.336},"max":{"1min":1.717,"5min":1.818,"15min":1.818},"last":1.110},{"interface":"front","average":{"1min":1.283,"5min":1.199,"15min":1.185},"min":{"1min":0.757,"5min":0.497,"15min":0.497},"max":{"1min":2.058,"5min":2.058,"15min":2.058},"last":1.054}]},{"osd":7,"last update":"Sun Dec 22 22:30:33 2019","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.285,"15min":1.266},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.463},{"interface":"front","average":{"1min":1.439,"5min":1.338,"15min":1.321},"min":{"1min":0.805,"5min":0.697,"15min":0.697},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.424}]},{"osd":8,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.507,"15min":1.503},"min":{"1min":0.895,"5min":0.895,"15min":0.895},"max":{"1min":1.842,"5min":2.214,"15min":2.214},"last":1.622},{"interface":"front","average":{"1min":1.473,"5min":1.465,"15min":1.463},"min":{"1min":1.043,"5min":1.014,"15min":1.014},"max":{"1min":2.236,"5min":2.258,"15min":2.258},"last":1.659}]},{"osd":9,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.563,"15min":1.563},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":2.172,"5min":2.172,"15min":2.172},"last":1.738},{"interface":"front","average":{"1min":57.350,"5min":57.350,"15min":57.350},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":746.735,"5min":746.735,"15min":746.735},"last":1.703}]},{"osd":10,"last update":"Sun Dec 22 22:30:33 2019","interfaces":[{"interface":"back","average":{"1min":1.596,"5min":1.596,"15min":1.596},"min":{"1min":1.132,"5min":1.132,"15min":1.132},"max":{"1min":2.338,"5min":2.338,"15min":2.338},"last":1.499},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.368,"5min":1.368,"15min":1.368},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.788}]}]}]}} 2019-12-22T22:31:10.249 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2019-12-22T22:31:10.249 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-12-22T22:31:10.250 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2019-12-22T22:31:10.250 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph health --format=json 2019-12-22T22:31:12.504 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:31:13.073 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-22T22:31:13.073 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2019-12-22T22:31:13.074 INFO:tasks.cephadm:Setup complete, yielding 2019-12-22T22:31:13.074 INFO:teuthology.run_tasks:Running task thrashosds... 2019-12-22T22:31:13.083 INFO:tasks.thrashosds:config is {'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'optrack_toggle_delay': 2.0, 'chance_test_map_discontinuity': 2, 'chance_pgpnum_fix': 0.25, 'timeout': 1800, 'chance_pgnum_grow': 0.25, 'sighup_delay': 0.1} 2019-12-22T22:31:13.083 INFO:tasks.thrashosds:overrides is {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow requests'], 'mon_bind_msgr2': False, 'conf': {'global': {'ms inject delay max': 1, 'ms inject delay type': 'osd', 'osd_pool_default_min_size': 2, 'ms bind msgr2': False, 'ms inject delay probability': 0.005, 'mon client directed command retry': 5, 'ms type': 'async', 'ms inject socket failures': 2500, 'osd_pool_default_size': 3, 'ms inject internal delays': 0.002}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'debug ms': 1, 'mon osdmap full prune min': 15, 'mon osdmap full prune interval': 2, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'osd op queue cut off': 'debug_random', 'debug ms': 1, 'debug journal': 20, 'osd scrub max interval': 120, 'osd max backfills': 6, 'debug osd': 25, 'osd debug verify cached snaps': True, 'osd map cache size': 1, 'osd debug verify missing on start': True, 'osd op queue': 'debug_random', 'osd backoff on peering': True, 'osd scrub min interval': 60, 'debug filestore': 20, 'osd shutdown pgref assert': True, 'osd scrub during recovery': False}}, 'sha1': '99b509ffd4dd354919b08b38ba83b998fbfdc107'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '99b509ffd4dd354919b08b38ba83b998fbfdc107'}}, 'admin_socket': {'branch': 'wip-sage-testing-2019-12-22-0931'}, 'thrashosds': {'min_in': 4}, 'workunit': {'sha1': 'abe4c1c94873149a777c88f919a579d57de0f422', 'branch': 'wip-old-clients-cephadm'}} 2019-12-22T22:31:13.084 INFO:tasks.thrashosds:config is {'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'optrack_toggle_delay': 2.0, 'chance_test_map_discontinuity': 2, 'chance_pgpnum_fix': 0.25, 'timeout': 1800, 'min_in': 4, 'chance_pgnum_grow': 0.25, 'sighup_delay': 0.1} 2019-12-22T22:31:13.084 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2019-12-22T22:31:15.775 INFO:tasks.thrashosds:Beginning thrashosds... 2019-12-22T22:31:15.775 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2019-12-22T22:31:15.775 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph pg dump --format=json 2019-12-22T22:31:18.054 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:31:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2019-12-22T22:31:18.624 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2019-12-22T22:31:16.083521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124941824,"kb_used":12589728,"kb_used_data":6720,"kb_used_omap":0,"kb_used_meta":12582912,"kb_avail":1112352096,"statfs":{"total":1151940427776,"available":1139048546304,"internally_reserved":12884901888,"allocated":6881280,"data_stored":2958948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12884901888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":15.516,"5min":15.516,"15min":15.516},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":294.724,"5min":294.724,"15min":294.724},"last":1.084},{"interface":"front","average":{"1min":29.217,"5min":29.217,"15min":29.217},"min":{"1min":0.681,"5min":0.681,"15min":0.681},"max":{"1min":567.422,"5min":567.422,"15min":567.422},"last":0.842}]},{"osd":1,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":0.957,"5min":0.957,"15min":0.957},"min":{"1min":0.610,"5min":0.610,"15min":0.610},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.413},{"interface":"front","average":{"1min":46.470,"5min":46.470,"15min":46.470},"min":{"1min":0.854,"5min":0.854,"15min":0.854},"max":{"1min":899.728,"5min":899.728,"15min":899.728},"last":0.896}]},{"osd":2,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":0.946,"5min":0.946,"15min":0.946},"min":{"1min":0.607,"5min":0.607,"15min":0.607},"max":{"1min":1.493,"5min":1.493,"15min":1.493},"last":1.141},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.685,"5min":0.685,"15min":0.685},"max":{"1min":1.529,"5min":1.529,"15min":1.529},"last":0.789}]},{"osd":3,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.168,"5min":1.168,"15min":1.168},"min":{"1min":0.813,"5min":0.813,"15min":0.813},"max":{"1min":1.850,"5min":1.850,"15min":1.850},"last":1.568},{"interface":"front","average":{"1min":1.729,"5min":1.729,"15min":1.729},"min":{"1min":0.880,"5min":0.880,"15min":0.880},"max":{"1min":11.220,"5min":11.220,"15min":11.220},"last":0.991}]},{"osd":4,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.783,"5min":1.783,"15min":1.783},"min":{"1min":1.001,"5min":1.001,"15min":1.001},"max":{"1min":11.106,"5min":11.106,"15min":11.106},"last":1.198},{"interface":"front","average":{"1min":1.313,"5min":1.313,"15min":1.313},"min":{"1min":0.939,"5min":0.939,"15min":0.939},"max":{"1min":1.689,"5min":1.689,"15min":1.689},"last":1.250}]},{"osd":5,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.396,"5min":1.396,"15min":1.396},"min":{"1min":1.167,"5min":1.167,"15min":1.167},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.799},{"interface":"front","average":{"1min":1.983,"5min":1.983,"15min":1.983},"min":{"1min":1.208,"5min":1.208,"15min":1.208},"max":{"1min":11.156,"5min":11.156,"15min":11.156},"last":1.526}]},{"osd":6,"last update":"Sun Dec 22 22:30:48 2019","interfaces":[{"interface":"back","average":{"1min":53.038,"5min":53.038,"15min":53.038},"min":{"1min":0.972,"5min":0.972,"15min":0.972},"max":{"1min":502.058,"5min":502.058,"15min":502.058},"last":1.486},{"interface":"front","average":{"1min":27.795,"5min":27.795,"15min":27.795},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":501.852,"5min":501.852,"15min":501.852},"last":1.700}]},{"osd":7,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.128,"5min":2.128,"15min":2.128},"last":1.817},{"interface":"front","average":{"1min":25.185,"5min":25.185,"15min":25.185},"min":{"1min":1.312,"5min":1.312,"15min":1.312},"max":{"1min":473.675,"5min":473.675,"15min":473.675},"last":1.325}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":37.192,"5min":37.192,"15min":37.192},"min":{"1min":1.274,"5min":1.274,"15min":1.274},"max":{"1min":502.226,"5min":502.226,"15min":502.226},"last":1.604},{"interface":"front","average":{"1min":1.682,"5min":1.682,"15min":1.682},"min":{"1min":1.399,"5min":1.399,"15min":1.399},"max":{"1min":2.170,"5min":2.170,"15min":2.170},"last":1.367}]},{"osd":10,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":2.178,"5min":2.178,"15min":2.178},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":11.281,"5min":11.281,"15min":11.281},"last":1.665},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.292,"5min":1.292,"15min":1.292},"max":{"1min":2.271,"5min":2.271,"15min":2.271},"last":1.740}]}]},{"osd":10,"up_from":58,"seq":249108103192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.608}]},{"osd":1,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.932,"5min":0.932,"15min":0.932},"min":{"1min":0.632,"5min":0.632,"15min":0.632},"max":{"1min":1.400,"5min":1.400,"15min":1.400},"last":0.956},{"interface":"front","average":{"1min":1.049,"5min":1.049,"15min":1.049},"min":{"1min":0.702,"5min":0.702,"15min":0.702},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.997}]},{"osd":2,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.994,"5min":0.994,"15min":0.994},"min":{"1min":0.729,"5min":0.729,"15min":0.729},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.140},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.790,"5min":0.790,"15min":0.790},"max":{"1min":1.710,"5min":1.710,"15min":1.710},"last":1.081}]},{"osd":3,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.927,"5min":0.927,"15min":0.927},"min":{"1min":0.678,"5min":0.678,"15min":0.678},"max":{"1min":1.574,"5min":1.574,"15min":1.574},"last":0.609},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.639,"5min":0.639,"15min":0.639},"max":{"1min":1.497,"5min":1.497,"15min":1.497},"last":1.213}]},{"osd":4,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.732,"5min":0.732,"15min":0.732},"max":{"1min":1.811,"5min":1.811,"15min":1.811},"last":1.278},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.540,"5min":1.540,"15min":1.540},"last":1.427}]},{"osd":5,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.515,"5min":1.515,"15min":1.515},"min":{"1min":0.902,"5min":0.902,"15min":0.902},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.631},{"interface":"front","average":{"1min":1.291,"5min":1.291,"15min":1.291},"min":{"1min":0.794,"5min":0.794,"15min":0.794},"max":{"1min":1.981,"5min":1.981,"15min":1.981},"last":1.319}]},{"osd":6,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.434,"5min":1.434,"15min":1.434},"min":{"1min":1.134,"5min":1.134,"15min":1.134},"max":{"1min":1.902,"5min":1.902,"15min":1.902},"last":1.400},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.150,"5min":1.150,"15min":1.150},"max":{"1min":1.963,"5min":1.963,"15min":1.963},"last":1.559}]},{"osd":7,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.835,"5min":0.835,"15min":0.835},"max":{"1min":1.842,"5min":1.842,"15min":1.842},"last":1.362},{"interface":"front","average":{"1min":59.900,"5min":59.900,"15min":59.900},"min":{"1min":0.814,"5min":0.814,"15min":0.814},"max":{"1min":822.803,"5min":822.803,"15min":822.803},"last":0.872}]},{"osd":8,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.380,"5min":1.380,"15min":1.380},"min":{"1min":0.698,"5min":0.698,"15min":0.698},"max":{"1min":1.844,"5min":1.844,"15min":1.844},"last":1.502},{"interface":"front","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.899,"5min":0.899,"15min":0.899},"max":{"1min":2.210,"5min":2.210,"15min":2.210},"last":1.719}]},{"osd":9,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.783,"5min":1.783,"15min":1.783},"min":{"1min":0.990,"5min":0.990,"15min":0.990},"max":{"1min":2.650,"5min":2.650,"15min":2.650},"last":1.462},{"interface":"front","average":{"1min":1.320,"5min":1.320,"15min":1.320},"min":{"1min":0.858,"5min":0.858,"15min":0.858},"max":{"1min":1.934,"5min":1.934,"15min":1.934},"last":0.815}]},{"osd":11,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":123.350,"5min":123.350,"15min":123.350},"min":{"1min":1.156,"5min":1.156,"15min":1.156},"max":{"1min":999.700,"5min":999.700,"15min":999.700},"last":1.595},{"interface":"front","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":1.324,"5min":1.324,"15min":1.324},"max":{"1min":2.135,"5min":2.135,"15min":2.135},"last":1.679}]}]},{"osd":9,"up_from":52,"seq":223338299420,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":0.942,"5min":1.118,"15min":1.148},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":1.466,"5min":2.541,"15min":2.541},"last":1.115},{"interface":"front","average":{"1min":1.046,"5min":1.171,"15min":1.192},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.651,"5min":2.110,"15min":2.110},"last":1.237}]},{"osd":1,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":0.884,"5min":8.908,"15min":10.245},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.569,"5min":167.232,"15min":167.232},"last":0.866},{"interface":"front","average":{"1min":0.932,"5min":1.137,"15min":1.171},"min":{"1min":0.667,"5min":0.667,"15min":0.667},"max":{"1min":1.333,"5min":1.844,"15min":1.844},"last":0.819}]},{"osd":2,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":0.947,"5min":1.157,"15min":1.192},"min":{"1min":0.561,"5min":0.561,"15min":0.561},"max":{"1min":1.409,"5min":1.738,"15min":1.738},"last":0.955},{"interface":"front","average":{"1min":1.063,"5min":64.273,"15min":74.808},"min":{"1min":0.682,"5min":0.668,"15min":0.668},"max":{"1min":1.699,"5min":737.478,"15min":737.478},"last":1.539}]},{"osd":3,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":0.986,"5min":1.082,"15min":1.098},"min":{"1min":0.573,"5min":0.573,"15min":0.573},"max":{"1min":1.559,"5min":1.927,"15min":1.927},"last":0.697},{"interface":"front","average":{"1min":1.193,"5min":1.337,"15min":1.361},"min":{"1min":0.616,"5min":0.616,"15min":0.616},"max":{"1min":1.734,"5min":1.974,"15min":1.974},"last":1.011}]},{"osd":4,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":1.217,"5min":1.375,"15min":1.401},"min":{"1min":0.972,"5min":0.720,"15min":0.720},"max":{"1min":1.510,"5min":2.723,"15min":2.723},"last":1.478},{"interface":"front","average":{"1min":1.432,"5min":1.652,"15min":1.689},"min":{"1min":0.823,"5min":0.823,"15min":0.823},"max":{"1min":1.925,"5min":4.343,"15min":4.343},"last":1.728}]},{"osd":5,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":11.543,"5min":3.565,"15min":2.235},"min":{"1min":0.885,"5min":0.885,"15min":0.885},"max":{"1min":244.595,"5min":244.595,"15min":244.595},"last":1.356},{"interface":"front","average":{"1min":1.169,"5min":1.300,"15min":1.322},"min":{"1min":0.801,"5min":0.801,"15min":0.801},"max":{"1min":1.426,"5min":2.098,"15min":2.098},"last":1.199}]},{"osd":6,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.734,"15min":1.776},"min":{"1min":1.168,"5min":1.168,"15min":1.168},"max":{"1min":1.750,"5min":4.278,"15min":4.278},"last":1.699},{"interface":"front","average":{"1min":1.567,"5min":1.578,"15min":1.580},"min":{"1min":1.336,"5min":1.036,"15min":1.036},"max":{"1min":1.828,"5min":2.868,"15min":2.868},"last":1.828}]},{"osd":7,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":1.470,"5min":1.725,"15min":1.767},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":1.702,"5min":4.383,"15min":4.383},"last":1.650},{"interface":"front","average":{"1min":42.251,"5min":9.699,"15min":4.273},"min":{"1min":0.946,"5min":0.823,"15min":0.823},"max":{"1min":857.161,"5min":857.161,"15min":857.161},"last":1.312}]},{"osd":8,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":1.572,"5min":1.904,"15min":1.960},"min":{"1min":1.302,"5min":1.008,"15min":1.008},"max":{"1min":1.909,"5min":5.958,"15min":5.958},"last":1.909},{"interface":"front","average":{"1min":1.311,"5min":8.433,"15min":9.620},"min":{"1min":1.011,"5min":0.935,"15min":0.935},"max":{"1min":1.601,"5min":137.259,"15min":137.259},"last":1.601}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":1.766,"15min":1.766},"min":{"1min":1.228,"5min":1.228,"15min":1.228},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.992},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":2.753,"5min":2.753,"15min":2.753},"last":1.427}]}]},{"osd":8,"up_from":47,"seq":201863462946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.914,"5min":0.927,"15min":0.929},"min":{"1min":0.516,"5min":0.471,"15min":0.471},"max":{"1min":1.450,"5min":1.640,"15min":1.640},"last":1.437},{"interface":"front","average":{"1min":0.960,"5min":0.924,"15min":0.918},"min":{"1min":0.527,"5min":0.527,"15min":0.527},"max":{"1min":1.607,"5min":1.841,"15min":1.841},"last":0.733}]},{"osd":1,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":15.598,"5min":27.074,"15min":28.987},"min":{"1min":0.686,"5min":0.556,"15min":0.556},"max":{"1min":291.598,"5min":503.201,"15min":503.201},"last":1.039},{"interface":"front","average":{"1min":1.076,"5min":23.305,"15min":27.010},"min":{"1min":0.473,"5min":0.451,"15min":0.451},"max":{"1min":1.652,"5min":502.942,"15min":502.942},"last":1.155}]},{"osd":2,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.900,"5min":0.972,"15min":0.984},"min":{"1min":0.470,"5min":0.470,"15min":0.470},"max":{"1min":1.506,"5min":1.620,"15min":1.620},"last":0.969},{"interface":"front","average":{"1min":1.076,"5min":1.200,"15min":1.221},"min":{"1min":0.583,"5min":0.550,"15min":0.550},"max":{"1min":1.833,"5min":4.085,"15min":4.085},"last":0.871}]},{"osd":3,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.118,"5min":1.210,"15min":1.225},"min":{"1min":0.657,"5min":0.657,"15min":0.657},"max":{"1min":2.076,"5min":2.106,"15min":2.106},"last":1.275},{"interface":"front","average":{"1min":1.038,"5min":1.138,"15min":1.154},"min":{"1min":0.598,"5min":0.598,"15min":0.598},"max":{"1min":1.590,"5min":2.000,"15min":2.000},"last":1.827}]},{"osd":4,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.215,"5min":1.231,"15min":1.233},"min":{"1min":0.685,"5min":0.661,"15min":0.661},"max":{"1min":1.876,"5min":2.171,"15min":2.171},"last":1.556},{"interface":"front","average":{"1min":46.986,"5min":10.675,"15min":4.623},"min":{"1min":0.648,"5min":0.648,"15min":0.648},"max":{"1min":965.121,"5min":965.121,"15min":965.121},"last":1.202}]},{"osd":5,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.398,"5min":1.592,"15min":1.624},"min":{"1min":0.765,"5min":0.765,"15min":0.765},"max":{"1min":1.897,"5min":4.220,"15min":4.220},"last":1.956},{"interface":"front","average":{"1min":1.379,"5min":1.441,"15min":1.451},"min":{"1min":0.807,"5min":0.677,"15min":0.677},"max":{"1min":1.805,"5min":2.262,"15min":2.262},"last":1.909}]},{"osd":6,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.527,"15min":1.594},"min":{"1min":0.645,"5min":0.645,"15min":0.645},"max":{"1min":1.798,"5min":8.757,"15min":8.757},"last":1.493},{"interface":"front","average":{"1min":4.965,"5min":2.294,"15min":1.849},"min":{"1min":0.719,"5min":0.719,"15min":0.719},"max":{"1min":77.942,"5min":77.942,"15min":77.942},"last":1.783}]},{"osd":7,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.476,"15min":1.474},"min":{"1min":1.200,"5min":0.950,"15min":0.950},"max":{"1min":2.124,"5min":2.409,"15min":2.409},"last":1.692},{"interface":"front","average":{"1min":1.610,"5min":1.902,"15min":1.951},"min":{"1min":1.296,"5min":0.984,"15min":0.984},"max":{"1min":2.329,"5min":8.832,"15min":8.832},"last":2.087}]},{"osd":9,"last update":"Sun Dec 22 22:31:12 2019","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.907,"5min":0.907,"15min":0.907},"max":{"1min":2.035,"5min":2.528,"15min":2.528},"last":2.024},{"interface":"front","average":{"1min":1.321,"5min":1.377,"15min":1.387},"min":{"1min":0.943,"5min":0.769,"15min":0.769},"max":{"1min":1.528,"5min":2.219,"15min":2.219},"last":1.347}]},{"osd":10,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.740,"5min":0.740,"15min":0.740},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.615},{"interface":"front","average":{"1min":1.616,"5min":1.616,"15min":1.616},"min":{"1min":1.010,"5min":1.010,"15min":1.010},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":2.159}]}]},{"osd":7,"up_from":42,"seq":180388626469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.114,"15min":1.124},"min":{"1min":0.720,"5min":0.605,"15min":0.605},"max":{"1min":1.383,"5min":1.864,"15min":1.864},"last":0.870},{"interface":"front","average":{"1min":1.190,"5min":1.127,"15min":1.117},"min":{"1min":0.714,"5min":0.707,"15min":0.707},"max":{"1min":1.578,"5min":1.594,"15min":1.594},"last":1.103}]},{"osd":1,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":51.076,"5min":11.162,"15min":4.510},"min":{"1min":0.656,"5min":0.656,"15min":0.656},"max":{"1min":851.679,"5min":851.679,"15min":851.679},"last":0.546},{"interface":"front","average":{"1min":1.072,"5min":1.038,"15min":1.032},"min":{"1min":0.615,"5min":0.615,"15min":0.615},"max":{"1min":1.505,"5min":1.637,"15min":1.637},"last":0.825}]},{"osd":2,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.024,"15min":1.029},"min":{"1min":0.652,"5min":0.652,"15min":0.652},"max":{"1min":1.369,"5min":1.565,"15min":1.565},"last":0.916},{"interface":"front","average":{"1min":1.071,"5min":23.176,"15min":26.860},"min":{"1min":0.695,"5min":0.685,"15min":0.685},"max":{"1min":1.436,"5min":579.355,"15min":579.355},"last":1.043}]},{"osd":3,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":35.627,"5min":8.027,"15min":3.427},"min":{"1min":0.702,"5min":0.668,"15min":0.668},"max":{"1min":588.429,"5min":588.429,"15min":588.429},"last":0.759},{"interface":"front","average":{"1min":1.047,"5min":2.209,"15min":2.403},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.362,"5min":28.026,"15min":28.026},"last":0.997}]},{"osd":4,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.074,"5min":1.039,"15min":1.033},"min":{"1min":0.813,"5min":0.546,"15min":0.546},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.724},{"interface":"front","average":{"1min":1.067,"5min":1.035,"15min":1.029},"min":{"1min":0.563,"5min":0.563,"15min":0.563},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.147}]},{"osd":5,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.223,"5min":1.308,"15min":1.322},"min":{"1min":0.648,"5min":0.648,"15min":0.648},"max":{"1min":1.701,"5min":2.001,"15min":2.001},"last":1.212},{"interface":"front","average":{"1min":1.363,"5min":9.607,"15min":10.981},"min":{"1min":1.005,"5min":1.005,"15min":1.005},"max":{"1min":1.657,"5min":217.508,"15min":217.508},"last":1.249}]},{"osd":6,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.366,"5min":1.353,"15min":1.351},"min":{"1min":0.856,"5min":0.856,"15min":0.856},"max":{"1min":1.621,"5min":1.943,"15min":1.943},"last":0.967},{"interface":"front","average":{"1min":1.229,"5min":1.258,"15min":1.263},"min":{"1min":0.836,"5min":0.696,"15min":0.696},"max":{"1min":1.607,"5min":1.749,"15min":1.749},"last":1.188}]},{"osd":8,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.473,"5min":1.517,"15min":1.524},"min":{"1min":0.903,"5min":0.903,"15min":0.903},"max":{"1min":1.882,"5min":1.883,"15min":1.883},"last":1.392},{"interface":"front","average":{"1min":56.141,"5min":12.489,"15min":5.213},"min":{"1min":1.313,"5min":1.313,"15min":1.313},"max":{"1min":929.400,"5min":929.400,"15min":929.400},"last":1.493}]},{"osd":9,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":91.448,"5min":19.552,"15min":7.569},"min":{"1min":0.972,"5min":0.972,"15min":0.972},"max":{"1min":993.911,"5min":993.911,"15min":993.911},"last":1.319},{"interface":"front","average":{"1min":1.593,"5min":1.639,"15min":1.647},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":1.843,"5min":1.892,"15min":1.892},"last":1.429}]},{"osd":10,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.604,"5min":1.604,"15min":1.604},"min":{"1min":1.199,"5min":1.199,"15min":1.199},"max":{"1min":1.951,"5min":1.951,"15min":1.951},"last":1.355},{"interface":"front","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.441,"5min":1.441,"15min":1.441},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.460}]}]},{"osd":6,"up_from":37,"seq":158913789992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.182,"5min":1.189,"15min":1.195},"min":{"1min":0.798,"5min":0.644,"15min":0.644},"max":{"1min":1.646,"5min":1.877,"15min":1.877},"last":1.427},{"interface":"front","average":{"1min":0.997,"5min":1.031,"15min":1.039},"min":{"1min":0.607,"5min":0.607,"15min":0.607},"max":{"1min":1.414,"5min":1.905,"15min":1.905},"last":0.965}]},{"osd":1,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.055,"15min":1.002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.511,"5min":2.130,"15min":2.130},"last":0.869},{"interface":"front","average":{"1min":1.026,"5min":3.041,"15min":1.677},"min":{"1min":0.652,"5min":0.554,"15min":0.554},"max":{"1min":1.605,"5min":215.806,"15min":215.806},"last":1.143}]},{"osd":2,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":47.962,"5min":44.903,"15min":53.978},"min":{"1min":0.711,"5min":0.673,"15min":0.673},"max":{"1min":892.790,"5min":892.790,"15min":892.790},"last":0.819},{"interface":"front","average":{"1min":20.589,"5min":4.995,"15min":2.394},"min":{"1min":0.756,"5min":0.622,"15min":0.622},"max":{"1min":368.137,"5min":368.137,"15min":368.137},"last":1.498}]},{"osd":3,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.009,"15min":1.018},"min":{"1min":0.588,"5min":0.588,"15min":0.588},"max":{"1min":1.348,"5min":1.772,"15min":1.772},"last":1.298},{"interface":"front","average":{"1min":1.102,"5min":1.053,"15min":1.041},"min":{"1min":0.728,"5min":0.682,"15min":0.682},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.728}]},{"osd":4,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.034,"15min":1.011},"min":{"1min":0.676,"5min":0.544,"15min":0.544},"max":{"1min":1.647,"5min":1.920,"15min":1.920},"last":1.627},{"interface":"front","average":{"1min":28.459,"5min":6.490,"15min":2.812},"min":{"1min":0.578,"5min":0.540,"15min":0.540},"max":{"1min":523.313,"5min":523.313,"15min":523.313},"last":1.098}]},{"osd":5,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.193,"5min":1.224,"15min":1.230},"min":{"1min":0.910,"5min":0.602,"15min":0.602},"max":{"1min":1.482,"5min":2.279,"15min":2.279},"last":1.383},{"interface":"front","average":{"1min":30.914,"5min":7.363,"15min":3.445},"min":{"1min":1.073,"5min":0.958,"15min":0.958},"max":{"1min":560.624,"5min":560.624,"15min":560.624},"last":1.731}]},{"osd":7,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.435,"5min":1.350,"15min":1.336},"min":{"1min":0.638,"5min":0.638,"15min":0.638},"max":{"1min":1.963,"5min":1.963,"15min":1.963},"last":1.800},{"interface":"front","average":{"1min":1.242,"5min":1.248,"15min":1.249},"min":{"1min":0.834,"5min":0.834,"15min":0.834},"max":{"1min":1.780,"5min":1.780,"15min":1.780},"last":1.036}]},{"osd":8,"last update":"Sun Dec 22 22:30:51 2019","interfaces":[{"interface":"back","average":{"1min":43.697,"5min":9.814,"15min":4.167},"min":{"1min":0.940,"5min":0.873,"15min":0.873},"max":{"1min":449.604,"5min":449.604,"15min":449.604},"last":1.248},{"interface":"front","average":{"1min":30.044,"5min":7.260,"15min":3.462},"min":{"1min":1.353,"5min":1.272,"15min":1.272},"max":{"1min":596.398,"5min":596.398,"15min":596.398},"last":1.900}]},{"osd":9,"last update":"Sun Dec 22 22:31:08 2019","interfaces":[{"interface":"back","average":{"1min":1.676,"5min":1.691,"15min":1.693},"min":{"1min":1.235,"5min":1.235,"15min":1.235},"max":{"1min":2.301,"5min":2.784,"15min":2.784},"last":1.940},{"interface":"front","average":{"1min":1.488,"5min":1.464,"15min":1.460},"min":{"1min":0.978,"5min":0.978,"15min":0.978},"max":{"1min":2.132,"5min":2.132,"15min":2.132},"last":1.562}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.533,"15min":1.533},"min":{"1min":1.188,"5min":1.188,"15min":1.188},"max":{"1min":2.030,"5min":2.030,"15min":2.030},"last":1.674},{"interface":"front","average":{"1min":14.761,"5min":14.761,"15min":14.761},"min":{"1min":1.040,"5min":1.040,"15min":1.040},"max":{"1min":279.809,"5min":279.809,"15min":279.809},"last":1.360}]}]},{"osd":1,"up_from":12,"seq":51539607612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":0.799,"5min":4.913,"15min":1.997},"min":{"1min":0.481,"5min":0.301,"15min":0.301},"max":{"1min":2.181,"5min":447.710,"15min":447.710},"last":1.077},{"interface":"front","average":{"1min":31.591,"5min":6.856,"15min":2.701},"min":{"1min":0.520,"5min":0.337,"15min":0.337},"max":{"1min":522.718,"5min":522.718,"15min":522.718},"last":0.608}]},{"osd":2,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":0.868,"5min":0.749,"15min":0.698},"min":{"1min":0.582,"5min":0.431,"15min":0.431},"max":{"1min":1.490,"5min":1.490,"15min":1.490},"last":0.657},{"interface":"front","average":{"1min":0.860,"5min":0.746,"15min":0.701},"min":{"1min":0.515,"5min":0.496,"15min":0.496},"max":{"1min":1.336,"5min":1.336,"15min":1.336},"last":0.943}]},{"osd":3,"last update":"Sun Dec 22 22:30:20 2019","interfaces":[{"interface":"back","average":{"1min":0.850,"5min":0.789,"15min":0.771},"min":{"1min":0.534,"5min":0.534,"15min":0.534},"max":{"1min":1.428,"5min":1.428,"15min":1.428},"last":1.123},{"interface":"front","average":{"1min":0.991,"5min":7.186,"15min":3.012},"min":{"1min":0.723,"5min":0.691,"15min":0.691},"max":{"1min":1.316,"5min":686.743,"15min":686.743},"last":1.197}]},{"osd":4,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":1.008,"15min":0.979},"min":{"1min":0.750,"5min":0.488,"15min":0.488},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.637},{"interface":"front","average":{"1min":51.506,"5min":11.073,"15min":4.301},"min":{"1min":0.765,"5min":0.710,"15min":0.710},"max":{"1min":856.751,"5min":856.751,"15min":856.751},"last":1.223}]},{"osd":5,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":1.257,"5min":1.102,"15min":1.053},"min":{"1min":0.657,"5min":0.657,"15min":0.657},"max":{"1min":2.315,"5min":2.315,"15min":2.315},"last":0.817},{"interface":"front","average":{"1min":1.255,"5min":1.143,"15min":1.107},"min":{"1min":0.931,"5min":0.768,"15min":0.768},"max":{"1min":1.822,"5min":1.822,"15min":1.822},"last":1.165}]},{"osd":6,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":1.227,"5min":5.041,"15min":2.425},"min":{"1min":0.686,"5min":0.678,"15min":0.678},"max":{"1min":1.636,"5min":350.575,"15min":350.575},"last":1.417},{"interface":"front","average":{"1min":1.210,"5min":1.194,"15min":1.168},"min":{"1min":0.818,"5min":0.752,"15min":0.752},"max":{"1min":1.726,"5min":2.022,"15min":2.022},"last":1.522}]},{"osd":7,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":50.092,"5min":11.052,"15min":4.546},"min":{"1min":0.661,"5min":0.661,"15min":0.661},"max":{"1min":830.970,"5min":830.970,"15min":830.970},"last":1.360},{"interface":"front","average":{"1min":1.229,"5min":1.322,"15min":1.338},"min":{"1min":0.868,"5min":0.868,"15min":0.868},"max":{"1min":1.679,"5min":2.080,"15min":2.080},"last":1.325}]},{"osd":8,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":31.817,"5min":58.579,"15min":63.039},"min":{"1min":0.990,"5min":0.894,"15min":0.894},"max":{"1min":487.747,"5min":993.474,"15min":993.474},"last":1.489},{"interface":"front","average":{"1min":34.569,"5min":8.068,"15min":3.651},"min":{"1min":1.040,"5min":1.040,"15min":1.040},"max":{"1min":532.136,"5min":532.136,"15min":532.136},"last":1.397}]},{"osd":9,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":31.563,"15min":36.601},"min":{"1min":0.843,"5min":0.843,"15min":0.843},"max":{"1min":1.655,"5min":715.827,"15min":715.827},"last":1.462},{"interface":"front","average":{"1min":1.243,"5min":1.343,"15min":1.360},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":2.475,"5min":2.475,"15min":2.475},"last":0.876}]},{"osd":10,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.102,"5min":2.102,"15min":2.102},"last":473.752},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":1.213,"5min":1.213,"15min":1.213},"max":{"1min":2.140,"5min":2.140,"15min":2.140},"last":1.549}]}]},{"osd":0,"up_from":7,"seq":30064771137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":0.792,"5min":1.323,"15min":0.793},"min":{"1min":0.493,"5min":0.346,"15min":0.346},"max":{"1min":1.382,"5min":68.607,"15min":68.607},"last":640.014},{"interface":"front","average":{"1min":19.114,"5min":4.388,"15min":1.857},"min":{"1min":0.583,"5min":0.404,"15min":0.404},"max":{"1min":381.781,"5min":381.781,"15min":381.781},"last":0.783}]},{"osd":2,"last update":"Sun Dec 22 22:28:51 2019","interfaces":[{"interface":"back","average":{"1min":23.953,"5min":5.351,"15min":2.251},"min":{"1min":0.488,"5min":0.444,"15min":0.444},"max":{"1min":501.694,"5min":501.694,"15min":501.694},"last":1.446},{"interface":"front","average":{"1min":22.535,"5min":5.030,"15min":2.112},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":501.287,"5min":501.287,"15min":501.287},"last":0.805}]},{"osd":3,"last update":"Sun Dec 22 22:30:15 2019","interfaces":[{"interface":"back","average":{"1min":0.912,"5min":0.755,"15min":0.696},"min":{"1min":0.593,"5min":0.523,"15min":0.523},"max":{"1min":1.483,"5min":1.483,"15min":1.483},"last":0.914},{"interface":"front","average":{"1min":31.437,"5min":6.969,"15min":2.875},"min":{"1min":0.564,"5min":0.564,"15min":0.564},"max":{"1min":548.602,"5min":548.602,"15min":548.602},"last":1.164}]},{"osd":4,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":1.130,"5min":1.103,"15min":1.091},"min":{"1min":0.787,"5min":0.680,"15min":0.680},"max":{"1min":1.773,"5min":2.152,"15min":2.152},"last":1.298},{"interface":"front","average":{"1min":1.056,"5min":16.051,"15min":6.020},"min":{"1min":0.723,"5min":0.723,"15min":0.723},"max":{"1min":1.526,"5min":995.256,"15min":995.256},"last":0.680}]},{"osd":5,"last update":"Sun Dec 22 22:30:56 2019","interfaces":[{"interface":"back","average":{"1min":1.290,"5min":1.155,"15min":1.111},"min":{"1min":0.864,"5min":0.819,"15min":0.819},"max":{"1min":1.933,"5min":1.933,"15min":1.933},"last":1.133},{"interface":"front","average":{"1min":35.092,"5min":7.988,"15min":3.436},"min":{"1min":0.793,"5min":0.671,"15min":0.671},"max":{"1min":677.586,"5min":677.586,"15min":677.586},"last":1.678}]},{"osd":6,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.364,"5min":1.238,"15min":1.217},"min":{"1min":0.733,"5min":0.709,"15min":0.709},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.629},{"interface":"front","average":{"1min":1.261,"5min":1.236,"15min":1.232},"min":{"1min":0.805,"5min":0.805,"15min":0.805},"max":{"1min":1.733,"5min":1.733,"15min":1.733},"last":0.856}]},{"osd":7,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.324,"5min":1.251,"15min":1.239},"min":{"1min":0.891,"5min":0.827,"15min":0.827},"max":{"1min":1.935,"5min":1.935,"15min":1.935},"last":1.266},{"interface":"front","average":{"1min":1.424,"5min":1.290,"15min":1.268},"min":{"1min":1.002,"5min":0.957,"15min":0.957},"max":{"1min":2.098,"5min":2.098,"15min":2.098},"last":1.407}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.553,"5min":1.544,"15min":1.542},"min":{"1min":1.185,"5min":0.964,"15min":0.964},"max":{"1min":2.131,"5min":2.341,"15min":2.341},"last":1.739},{"interface":"front","average":{"1min":1.462,"5min":1.435,"15min":1.431},"min":{"1min":0.856,"5min":0.856,"15min":0.856},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1.225}]},{"osd":9,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.592,"5min":1.592,"15min":1.592},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.544},{"interface":"front","average":{"1min":1.483,"5min":1.483,"15min":1.483},"min":{"1min":0.974,"5min":0.974,"15min":0.974},"max":{"1min":2.280,"5min":2.280,"15min":2.280},"last":1.506}]},{"osd":10,"last update":"Sun Dec 22 22:30:28 2019","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":2.408,"5min":2.408,"15min":2.408},"last":1.798},{"interface":"front","average":{"1min":1.477,"5min":1.477,"15min":1.477},"min":{"1min":0.889,"5min":0.889,"15min":0.889},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.362}]},{"osd":11,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":23.924,"5min":23.924,"15min":23.924},"min":{"1min":1.013,"5min":1.013,"15min":1.013},"max":{"1min":467.930,"5min":467.930,"15min":467.930},"last":1.581},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":1.242,"5min":1.242,"15min":1.242},"max":{"1min":2.114,"5min":2.114,"15min":2.114},"last":1.337}]}]},{"osd":2,"up_from":17,"seq":73014444087,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":0.884,"5min":0.707,"15min":0.617},"min":{"1min":0.411,"5min":0.411,"15min":0.411},"max":{"1min":1.677,"5min":1.863,"15min":1.863},"last":0.763},{"interface":"front","average":{"1min":0.934,"5min":3.822,"15min":1.704},"min":{"1min":0.539,"5min":0.315,"15min":0.315},"max":{"1min":1.642,"5min":272.186,"15min":272.186},"last":1.137}]},{"osd":1,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":0.953,"5min":4.723,"15min":1.993},"min":{"1min":0.438,"5min":0.391,"15min":0.391},"max":{"1min":1.821,"5min":357.558,"15min":357.558},"last":1.076},{"interface":"front","average":{"1min":0.953,"5min":0.834,"15min":0.716},"min":{"1min":0.492,"5min":0.390,"15min":0.390},"max":{"1min":2.259,"5min":2.259,"15min":2.259},"last":0.678}]},{"osd":3,"last update":"Sun Dec 22 22:30:15 2019","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.901,"15min":0.868},"min":{"1min":0.602,"5min":0.602,"15min":0.602},"max":{"1min":2.182,"5min":2.182,"15min":2.182},"last":0.693},{"interface":"front","average":{"1min":0.841,"5min":0.748,"15min":0.705},"min":{"1min":0.484,"5min":0.484,"15min":0.484},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.575}]},{"osd":4,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.122,"5min":1.053,"15min":1.031},"min":{"1min":0.666,"5min":0.666,"15min":0.666},"max":{"1min":2.111,"5min":2.111,"15min":2.111},"last":1.402},{"interface":"front","average":{"1min":1.253,"5min":1.062,"15min":1.018},"min":{"1min":0.931,"5min":0.664,"15min":0.664},"max":{"1min":2.045,"5min":2.045,"15min":2.045},"last":1.614}]},{"osd":5,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":50.784,"5min":13.329,"15min":7.725},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":944.730,"5min":944.730,"15min":944.730},"last":1.331},{"interface":"front","average":{"1min":1.290,"5min":1.148,"15min":1.106},"min":{"1min":0.671,"5min":0.671,"15min":0.671},"max":{"1min":2.526,"5min":2.526,"15min":2.526},"last":1.665}]},{"osd":6,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.234,"15min":1.239},"min":{"1min":0.787,"5min":0.743,"15min":0.743},"max":{"1min":1.761,"5min":2.381,"15min":2.381},"last":1.017},{"interface":"front","average":{"1min":1.232,"5min":1.248,"15min":1.250},"min":{"1min":0.757,"5min":0.757,"15min":0.757},"max":{"1min":1.929,"5min":2.467,"15min":2.467},"last":1.362}]},{"osd":7,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.487,"5min":1.336,"15min":1.311},"min":{"1min":0.860,"5min":0.860,"15min":0.860},"max":{"1min":2.811,"5min":2.811,"15min":2.811},"last":1.801},{"interface":"front","average":{"1min":1.588,"5min":17.128,"15min":19.718},"min":{"1min":1.030,"5min":1.030,"15min":1.030},"max":{"1min":2.874,"5min":412.794,"15min":412.794},"last":1.837}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.382,"5min":1.450,"15min":1.461},"min":{"1min":0.632,"5min":0.632,"15min":0.632},"max":{"1min":2.672,"5min":2.672,"15min":2.672},"last":1.454},{"interface":"front","average":{"1min":1.487,"5min":1.378,"15min":1.360},"min":{"1min":0.690,"5min":0.690,"15min":0.690},"max":{"1min":2.420,"5min":2.420,"15min":2.420},"last":1.756}]},{"osd":9,"last update":"Sun Dec 22 22:31:11 2019","interfaces":[{"interface":"back","average":{"1min":40.612,"5min":9.244,"15min":4.016},"min":{"1min":0.934,"5min":0.890,"15min":0.890},"max":{"1min":667.949,"5min":667.949,"15min":667.949},"last":1.363},{"interface":"front","average":{"1min":1.485,"5min":1.521,"15min":1.527},"min":{"1min":0.818,"5min":0.818,"15min":0.818},"max":{"1min":1.956,"5min":2.619,"15min":2.619},"last":1.572}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":54.553,"5min":54.553,"15min":54.553},"min":{"1min":1.147,"5min":1.147,"15min":1.147},"max":{"1min":501.863,"5min":501.863,"15min":501.863},"last":1.426},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.704,"5min":2.704,"15min":2.704},"last":1.720}]}]},{"osd":3,"up_from":22,"seq":94489280565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:29:14 2019","interfaces":[{"interface":"back","average":{"1min":0.843,"5min":0.692,"15min":0.667},"min":{"1min":0.625,"5min":0.474,"15min":0.474},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.609},{"interface":"front","average":{"1min":0.867,"5min":0.742,"15min":0.721},"min":{"1min":0.556,"5min":0.527,"15min":0.527},"max":{"1min":1.555,"5min":1.555,"15min":1.555},"last":0.707}]},{"osd":1,"last update":"Sun Dec 22 22:30:18 2019","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.797,"15min":0.784},"min":{"1min":0.415,"5min":0.415,"15min":0.415},"max":{"1min":1.527,"5min":1.527,"15min":1.527},"last":0.733},{"interface":"front","average":{"1min":0.922,"5min":5.827,"15min":2.559},"min":{"1min":0.511,"5min":0.511,"15min":0.511},"max":{"1min":3.372,"5min":467.732,"15min":467.732},"last":0.578}]},{"osd":2,"last update":"Sun Dec 22 22:30:18 2019","interfaces":[{"interface":"back","average":{"1min":29.972,"5min":6.561,"15min":2.632},"min":{"1min":0.485,"5min":0.485,"15min":0.485},"max":{"1min":667.845,"5min":667.845,"15min":667.845},"last":0.686},{"interface":"front","average":{"1min":0.948,"5min":0.829,"15min":0.776},"min":{"1min":0.523,"5min":0.455,"15min":0.455},"max":{"1min":1.940,"5min":1.940,"15min":1.940},"last":0.952}]},{"osd":4,"last update":"Sun Dec 22 22:30:37 2019","interfaces":[{"interface":"back","average":{"1min":1.265,"5min":1.121,"15min":1.067},"min":{"1min":0.772,"5min":0.652,"15min":0.652},"max":{"1min":2.961,"5min":2.961,"15min":2.961},"last":0.999},{"interface":"front","average":{"1min":1.312,"5min":1.158,"15min":1.102},"min":{"1min":0.886,"5min":0.750,"15min":0.750},"max":{"1min":2.845,"5min":2.845,"15min":2.845},"last":1.126}]},{"osd":5,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.974,"5min":1.756,"15min":1.998},"min":{"1min":0.609,"5min":0.609,"15min":0.609},"max":{"1min":1.561,"5min":24.295,"15min":24.295},"last":1.043},{"interface":"front","average":{"1min":1.131,"5min":1.160,"15min":1.118},"min":{"1min":0.776,"5min":0.776,"15min":0.776},"max":{"1min":1.786,"5min":2.312,"15min":2.312},"last":0.896}]},{"osd":6,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":36.679,"5min":8.283,"15min":3.551},"min":{"1min":0.850,"5min":0.850,"15min":0.850},"max":{"1min":501.935,"5min":501.935,"15min":501.935},"last":1.432},{"interface":"front","average":{"1min":1.414,"5min":1.308,"15min":1.290},"min":{"1min":0.647,"5min":0.647,"15min":0.647},"max":{"1min":2.155,"5min":2.155,"15min":2.155},"last":1.176}]},{"osd":7,"last update":"Sun Dec 22 22:30:37 2019","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.387,"15min":1.393},"min":{"1min":0.804,"5min":0.804,"15min":0.804},"max":{"1min":3.156,"5min":3.156,"15min":3.156},"last":1.275},{"interface":"front","average":{"1min":1.261,"5min":1.340,"15min":1.353},"min":{"1min":0.650,"5min":0.650,"15min":0.650},"max":{"1min":2.523,"5min":2.523,"15min":2.523},"last":1.307}]},{"osd":8,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.320,"5min":34.304,"15min":39.801},"min":{"1min":0.811,"5min":0.811,"15min":0.811},"max":{"1min":1.970,"5min":820.143,"15min":820.143},"last":1.591},{"interface":"front","average":{"1min":15.298,"5min":4.367,"15min":2.545},"min":{"1min":0.840,"5min":0.840,"15min":0.840},"max":{"1min":292.729,"5min":292.729,"15min":292.729},"last":1.405}]},{"osd":9,"last update":"Sun Dec 22 22:31:11 2019","interfaces":[{"interface":"back","average":{"1min":21.370,"5min":5.570,"15min":2.936},"min":{"1min":0.926,"5min":0.926,"15min":0.926},"max":{"1min":321.219,"5min":321.219,"15min":321.219},"last":321.219},{"interface":"front","average":{"1min":1.253,"5min":1.530,"15min":1.576},"min":{"1min":0.862,"5min":0.862,"15min":0.862},"max":{"1min":1.686,"5min":3.233,"15min":3.233},"last":1.371}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":15.340,"5min":15.340,"15min":15.340},"min":{"1min":0.821,"5min":0.821,"15min":0.821},"max":{"1min":280.174,"5min":280.174,"15min":280.174},"last":1.552},{"interface":"front","average":{"1min":43.049,"5min":43.049,"15min":43.049},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":832.650,"5min":832.650,"15min":832.650},"last":1.482}]},{"osd":11,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":20.768,"5min":20.768,"15min":20.768},"min":{"1min":0.910,"5min":0.910,"15min":0.910},"max":{"1min":427.022,"5min":427.022,"15min":427.022},"last":1.648},{"interface":"front","average":{"1min":37.520,"5min":37.520,"15min":37.520},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":792.516,"5min":792.516,"15min":792.516},"last":1.508}]}]},{"osd":4,"up_from":27,"seq":115964117039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.055,"5min":1.073,"15min":1.069},"min":{"1min":0.652,"5min":0.649,"15min":0.649},"max":{"1min":1.479,"5min":1.942,"15min":1.942},"last":1.189},{"interface":"front","average":{"1min":1.173,"5min":1.107,"15min":1.098},"min":{"1min":0.824,"5min":0.721,"15min":0.721},"max":{"1min":1.620,"5min":1.876,"15min":1.876},"last":1.276}]},{"osd":1,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":0.977,"5min":0.935,"15min":0.905},"min":{"1min":0.603,"5min":0.580,"15min":0.580},"max":{"1min":1.453,"5min":1.546,"15min":1.546},"last":0.663},{"interface":"front","average":{"1min":1.038,"5min":3.901,"15min":1.927},"min":{"1min":0.678,"5min":0.629,"15min":0.629},"max":{"1min":1.547,"5min":277.064,"15min":277.064},"last":0.948}]},{"osd":2,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":15.435,"15min":21.785},"min":{"1min":0.827,"5min":0.757,"15min":0.757},"max":{"1min":1.636,"5min":430.289,"15min":430.289},"last":1.022},{"interface":"front","average":{"1min":37.352,"5min":18.552,"15min":6.938},"min":{"1min":0.926,"5min":0.743,"15min":0.743},"max":{"1min":831.842,"5min":967.982,"15min":967.982},"last":1.328}]},{"osd":3,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":1.050,"15min":1.015},"min":{"1min":0.762,"5min":0.585,"15min":0.585},"max":{"1min":1.521,"5min":1.728,"15min":1.728},"last":0.898},{"interface":"front","average":{"1min":1.029,"5min":10.775,"15min":4.207},"min":{"1min":0.670,"5min":0.636,"15min":0.636},"max":{"1min":1.518,"5min":929.402,"15min":929.402},"last":1.069}]},{"osd":5,"last update":"Sun Dec 22 22:30:56 2019","interfaces":[{"interface":"back","average":{"1min":1.140,"5min":1.002,"15min":0.962},"min":{"1min":0.713,"5min":0.509,"15min":0.509},"max":{"1min":1.563,"5min":1.905,"15min":1.905},"last":0.805},{"interface":"front","average":{"1min":1.331,"5min":1.114,"15min":1.056},"min":{"1min":0.613,"5min":0.484,"15min":0.484},"max":{"1min":1.683,"5min":1.683,"15min":1.683},"last":1.120}]},{"osd":6,"last update":"Sun Dec 22 22:30:16 2019","interfaces":[{"interface":"back","average":{"1min":84.896,"5min":17.852,"15min":6.678},"min":{"1min":0.782,"5min":0.680,"15min":0.680},"max":{"1min":529.309,"5min":529.309,"15min":529.309},"last":0.984},{"interface":"front","average":{"1min":1.195,"5min":1.243,"15min":1.251},"min":{"1min":0.825,"5min":0.600,"15min":0.600},"max":{"1min":1.645,"5min":1.707,"15min":1.707},"last":0.841}]},{"osd":7,"last update":"Sun Dec 22 22:30:34 2019","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.259,"15min":1.247},"min":{"1min":0.783,"5min":0.623,"15min":0.623},"max":{"1min":1.678,"5min":1.678,"15min":1.678},"last":0.721},{"interface":"front","average":{"1min":1.228,"5min":1.299,"15min":1.311},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.721,"5min":1.721,"15min":1.721},"last":0.764}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.430,"5min":26.380,"15min":30.538},"min":{"1min":1.150,"5min":1.111,"15min":1.111},"max":{"1min":1.814,"5min":531.221,"15min":531.221},"last":1.526},{"interface":"front","average":{"1min":1.648,"5min":1.518,"15min":1.496},"min":{"1min":1.275,"5min":0.951,"15min":0.951},"max":{"1min":1.932,"5min":1.932,"15min":1.932},"last":1.500}]},{"osd":9,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":16.121,"5min":4.496,"15min":2.558},"min":{"1min":1.376,"5min":0.977,"15min":0.977},"max":{"1min":348.092,"5min":348.092,"15min":348.092},"last":1.447},{"interface":"front","average":{"1min":34.876,"5min":48.296,"15min":50.533},"min":{"1min":1.019,"5min":1.019,"15min":1.019},"max":{"1min":805.158,"5min":904.459,"15min":904.459},"last":1.247}]},{"osd":10,"last update":"Sun Dec 22 22:30:28 2019","interfaces":[{"interface":"back","average":{"1min":14.077,"5min":14.077,"15min":14.077},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":275.538,"5min":275.538,"15min":275.538},"last":1.690},{"interface":"front","average":{"1min":1.658,"5min":1.658,"15min":1.658},"min":{"1min":1.020,"5min":1.020,"15min":1.020},"max":{"1min":1.951,"5min":1.951,"15min":1.951},"last":1.529}]}]},{"osd":5,"up_from":32,"seq":137438953516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":5.148,"5min":1.819,"15min":1.260},"min":{"1min":0.760,"5min":0.568,"15min":0.568},"max":{"1min":75.068,"5min":75.068,"15min":75.068},"last":1.146},{"interface":"front","average":{"1min":1.262,"5min":1.041,"15min":0.969},"min":{"1min":0.680,"5min":0.630,"15min":0.630},"max":{"1min":5.292,"5min":5.292,"15min":5.292},"last":1.111}]},{"osd":1,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.259,"5min":24.901,"15min":35.449},"min":{"1min":0.780,"5min":0.453,"15min":0.453},"max":{"1min":5.195,"5min":637.713,"15min":637.713},"last":0.978},{"interface":"front","average":{"1min":1.231,"5min":1.080,"15min":1.043},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":5.080,"5min":5.080,"15min":5.080},"last":0.746}]},{"osd":2,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.328,"5min":1.015,"15min":0.943},"min":{"1min":0.759,"5min":0.526,"15min":0.526},"max":{"1min":5.239,"5min":5.239,"15min":5.239},"last":1.498},{"interface":"front","average":{"1min":48.970,"5min":10.645,"15min":4.233},"min":{"1min":0.614,"5min":0.614,"15min":0.614},"max":{"1min":906.443,"5min":906.443,"15min":906.443},"last":1.315}]},{"osd":3,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":32.944,"5min":7.425,"15min":3.155},"min":{"1min":0.684,"5min":0.544,"15min":0.544},"max":{"1min":601.608,"5min":601.608,"15min":601.608},"last":1.256},{"interface":"front","average":{"1min":1.403,"5min":1.143,"15min":1.075},"min":{"1min":0.733,"5min":0.581,"15min":0.581},"max":{"1min":5.351,"5min":5.351,"15min":5.351},"last":0.908}]},{"osd":4,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.059,"5min":5.945,"15min":2.619},"min":{"1min":0.575,"5min":0.426,"15min":0.426},"max":{"1min":2.019,"5min":447.758,"15min":447.758},"last":1.207},{"interface":"front","average":{"1min":1.242,"5min":1.117,"15min":1.061},"min":{"1min":0.766,"5min":0.368,"15min":0.368},"max":{"1min":1.561,"5min":1.862,"15min":1.862},"last":1.603}]},{"osd":6,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":1.285,"5min":1.114,"15min":1.086},"min":{"1min":0.825,"5min":0.336,"15min":0.336},"max":{"1min":1.717,"5min":1.818,"15min":1.818},"last":0.862},{"interface":"front","average":{"1min":1.283,"5min":1.199,"15min":1.185},"min":{"1min":0.757,"5min":0.497,"15min":0.497},"max":{"1min":2.058,"5min":2.058,"15min":2.058},"last":1.427}]},{"osd":7,"last update":"Sun Dec 22 22:30:33 2019","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.285,"15min":1.266},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.670},{"interface":"front","average":{"1min":1.439,"5min":1.338,"15min":1.321},"min":{"1min":0.805,"5min":0.697,"15min":0.697},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.545}]},{"osd":8,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.507,"15min":1.503},"min":{"1min":0.895,"5min":0.895,"15min":0.895},"max":{"1min":1.842,"5min":2.214,"15min":2.214},"last":1.747},{"interface":"front","average":{"1min":1.473,"5min":1.465,"15min":1.463},"min":{"1min":1.043,"5min":1.014,"15min":1.014},"max":{"1min":2.236,"5min":2.258,"15min":2.258},"last":1.641}]},{"osd":9,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":1.563,"5min":1.563,"15min":1.563},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":2.172,"5min":2.172,"15min":2.172},"last":1.710},{"interface":"front","average":{"1min":57.350,"5min":57.350,"15min":57.350},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":746.735,"5min":746.735,"15min":746.735},"last":1.830}]},{"osd":10,"last update":"Sun Dec 22 22:30:33 2019","interfaces":[{"interface":"back","average":{"1min":1.596,"5min":1.596,"15min":1.596},"min":{"1min":1.132,"5min":1.132,"15min":1.132},"max":{"1min":2.338,"5min":2.338,"15min":2.338},"last":1.787},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.368,"5min":1.368,"15min":1.368},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.864}]}]}]}} 2019-12-22T22:31:18.628 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph pg dump --format=json 2019-12-22T22:31:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: 2019-12-22T22:31:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2019-12-22T22:31:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2019-12-22T22:31:20.084168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124941824,"kb_used":12589728,"kb_used_data":6720,"kb_used_omap":0,"kb_used_meta":12582912,"kb_avail":1112352096,"statfs":{"total":1151940427776,"available":1139048546304,"internally_reserved":12884901888,"allocated":6881280,"data_stored":2958948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12884901888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":15.516,"5min":15.516,"15min":15.516},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":294.724,"5min":294.724,"15min":294.724},"last":1.084},{"interface":"front","average":{"1min":29.217,"5min":29.217,"15min":29.217},"min":{"1min":0.681,"5min":0.681,"15min":0.681},"max":{"1min":567.422,"5min":567.422,"15min":567.422},"last":0.842}]},{"osd":1,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":0.957,"5min":0.957,"15min":0.957},"min":{"1min":0.610,"5min":0.610,"15min":0.610},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.413},{"interface":"front","average":{"1min":46.470,"5min":46.470,"15min":46.470},"min":{"1min":0.854,"5min":0.854,"15min":0.854},"max":{"1min":899.728,"5min":899.728,"15min":899.728},"last":0.896}]},{"osd":2,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":0.946,"5min":0.946,"15min":0.946},"min":{"1min":0.607,"5min":0.607,"15min":0.607},"max":{"1min":1.493,"5min":1.493,"15min":1.493},"last":1.141},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.685,"5min":0.685,"15min":0.685},"max":{"1min":1.529,"5min":1.529,"15min":1.529},"last":0.789}]},{"osd":3,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.168,"5min":1.168,"15min":1.168},"min":{"1min":0.813,"5min":0.813,"15min":0.813},"max":{"1min":1.850,"5min":1.850,"15min":1.850},"last":1.568},{"interface":"front","average":{"1min":1.729,"5min":1.729,"15min":1.729},"min":{"1min":0.880,"5min":0.880,"15min":0.880},"max":{"1min":11.220,"5min":11.220,"15min":11.220},"last":0.991}]},{"osd":4,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.783,"5min":1.783,"15min":1.783},"min":{"1min":1.001,"5min":1.001,"15min":1.001},"max":{"1min":11.106,"5min":11.106,"15min":11.106},"last":1.198},{"interface":"front","average":{"1min":1.313,"5min":1.313,"15min":1.313},"min":{"1min":0.939,"5min":0.939,"15min":0.939},"max":{"1min":1.689,"5min":1.689,"15min":1.689},"last":1.250}]},{"osd":5,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.396,"5min":1.396,"15min":1.396},"min":{"1min":1.167,"5min":1.167,"15min":1.167},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.799},{"interface":"front","average":{"1min":1.983,"5min":1.983,"15min":1.983},"min":{"1min":1.208,"5min":1.208,"15min":1.208},"max":{"1min":11.156,"5min":11.156,"15min":11.156},"last":1.526}]},{"osd":6,"last update":"Sun Dec 22 22:30:48 2019","interfaces":[{"interface":"back","average":{"1min":53.038,"5min":53.038,"15min":53.038},"min":{"1min":0.972,"5min":0.972,"15min":0.972},"max":{"1min":502.058,"5min":502.058,"15min":502.058},"last":1.486},{"interface":"front","average":{"1min":27.795,"5min":27.795,"15min":27.795},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":501.852,"5min":501.852,"15min":501.852},"last":1.700}]},{"osd":7,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.128,"5min":2.128,"15min":2.128},"last":1.319},{"interface":"front","average":{"1min":25.185,"5min":25.185,"15min":25.185},"min":{"1min":1.312,"5min":1.312,"15min":1.312},"max":{"1min":473.675,"5min":473.675,"15min":473.675},"last":880.838}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":37.192,"5min":37.192,"15min":37.192},"min":{"1min":1.274,"5min":1.274,"15min":1.274},"max":{"1min":502.226,"5min":502.226,"15min":502.226},"last":1.604},{"interface":"front","average":{"1min":1.682,"5min":1.682,"15min":1.682},"min":{"1min":1.399,"5min":1.399,"15min":1.399},"max":{"1min":2.170,"5min":2.170,"15min":2.170},"last":1.367}]},{"osd":10,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":2.178,"5min":2.178,"15min":2.178},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":11.281,"5min":11.281,"15min":11.281},"last":1.665},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.292,"5min":1.292,"15min":1.292},"max":{"1min":2.271,"5min":2.271,"15min":2.271},"last":1.740}]}]},{"osd":10,"up_from":58,"seq":249108103193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.608}]},{"osd":1,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.932,"5min":0.932,"15min":0.932},"min":{"1min":0.632,"5min":0.632,"15min":0.632},"max":{"1min":1.400,"5min":1.400,"15min":1.400},"last":1.137},{"interface":"front","average":{"1min":1.049,"5min":1.049,"15min":1.049},"min":{"1min":0.702,"5min":0.702,"15min":0.702},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.107}]},{"osd":2,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.994,"5min":0.994,"15min":0.994},"min":{"1min":0.729,"5min":0.729,"15min":0.729},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.974},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.790,"5min":0.790,"15min":0.790},"max":{"1min":1.710,"5min":1.710,"15min":1.710},"last":0.774}]},{"osd":3,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":0.927,"5min":0.927,"15min":0.927},"min":{"1min":0.678,"5min":0.678,"15min":0.678},"max":{"1min":1.574,"5min":1.574,"15min":1.574},"last":0.686},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.639,"5min":0.639,"15min":0.639},"max":{"1min":1.497,"5min":1.497,"15min":1.497},"last":1.269}]},{"osd":4,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.732,"5min":0.732,"15min":0.732},"max":{"1min":1.811,"5min":1.811,"15min":1.811},"last":0.558},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.540,"5min":1.540,"15min":1.540},"last":1.344}]},{"osd":5,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.515,"5min":1.515,"15min":1.515},"min":{"1min":0.902,"5min":0.902,"15min":0.902},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.232},{"interface":"front","average":{"1min":1.291,"5min":1.291,"15min":1.291},"min":{"1min":0.794,"5min":0.794,"15min":0.794},"max":{"1min":1.981,"5min":1.981,"15min":1.981},"last":1.301}]},{"osd":6,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.434,"5min":1.434,"15min":1.434},"min":{"1min":1.134,"5min":1.134,"15min":1.134},"max":{"1min":1.902,"5min":1.902,"15min":1.902},"last":0.857},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.150,"5min":1.150,"15min":1.150},"max":{"1min":1.963,"5min":1.963,"15min":1.963},"last":1.053}]},{"osd":7,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.835,"5min":0.835,"15min":0.835},"max":{"1min":1.842,"5min":1.842,"15min":1.842},"last":1.182},{"interface":"front","average":{"1min":59.900,"5min":59.900,"15min":59.900},"min":{"1min":0.814,"5min":0.814,"15min":0.814},"max":{"1min":822.803,"5min":822.803,"15min":822.803},"last":0.814}]},{"osd":8,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.380,"5min":1.380,"15min":1.380},"min":{"1min":0.698,"5min":0.698,"15min":0.698},"max":{"1min":1.844,"5min":1.844,"15min":1.844},"last":1.515},{"interface":"front","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.899,"5min":0.899,"15min":0.899},"max":{"1min":2.210,"5min":2.210,"15min":2.210},"last":1.688}]},{"osd":9,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.783,"5min":1.783,"15min":1.783},"min":{"1min":0.990,"5min":0.990,"15min":0.990},"max":{"1min":2.650,"5min":2.650,"15min":2.650},"last":1.477},{"interface":"front","average":{"1min":1.320,"5min":1.320,"15min":1.320},"min":{"1min":0.858,"5min":0.858,"15min":0.858},"max":{"1min":1.934,"5min":1.934,"15min":1.934},"last":0.912}]},{"osd":11,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":123.350,"5min":123.350,"15min":123.350},"min":{"1min":1.156,"5min":1.156,"15min":1.156},"max":{"1min":999.700,"5min":999.700,"15min":999.700},"last":1.395},{"interface":"front","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":1.324,"5min":1.324,"15min":1.324},"max":{"1min":2.135,"5min":2.135,"15min":2.135},"last":1.527}]}]},{"osd":9,"up_from":52,"seq":223338299421,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":0.942,"5min":1.118,"15min":1.148},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":1.466,"5min":2.541,"15min":2.541},"last":1.071},{"interface":"front","average":{"1min":1.046,"5min":1.171,"15min":1.192},"min":{"1min":0.612,"5min":0.612,"15min":0.612},"max":{"1min":1.651,"5min":2.110,"15min":2.110},"last":0.866}]},{"osd":1,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":0.884,"5min":8.908,"15min":10.245},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.569,"5min":167.232,"15min":167.232},"last":0.815},{"interface":"front","average":{"1min":0.932,"5min":1.137,"15min":1.171},"min":{"1min":0.667,"5min":0.667,"15min":0.667},"max":{"1min":1.333,"5min":1.844,"15min":1.844},"last":1.279}]},{"osd":2,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":0.947,"5min":1.157,"15min":1.192},"min":{"1min":0.561,"5min":0.561,"15min":0.561},"max":{"1min":1.409,"5min":1.738,"15min":1.738},"last":0.775},{"interface":"front","average":{"1min":1.063,"5min":64.273,"15min":74.808},"min":{"1min":0.682,"5min":0.668,"15min":0.668},"max":{"1min":1.699,"5min":737.478,"15min":737.478},"last":1.205}]},{"osd":3,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":0.986,"5min":1.082,"15min":1.098},"min":{"1min":0.573,"5min":0.573,"15min":0.573},"max":{"1min":1.559,"5min":1.927,"15min":1.927},"last":1.396},{"interface":"front","average":{"1min":1.193,"5min":1.337,"15min":1.361},"min":{"1min":0.616,"5min":0.616,"15min":0.616},"max":{"1min":1.734,"5min":1.974,"15min":1.974},"last":1.510}]},{"osd":4,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":1.217,"5min":1.375,"15min":1.401},"min":{"1min":0.972,"5min":0.720,"15min":0.720},"max":{"1min":1.510,"5min":2.723,"15min":2.723},"last":1.434},{"interface":"front","average":{"1min":1.432,"5min":1.652,"15min":1.689},"min":{"1min":0.823,"5min":0.823,"15min":0.823},"max":{"1min":1.925,"5min":4.343,"15min":4.343},"last":1.665}]},{"osd":5,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":11.543,"5min":3.565,"15min":2.235},"min":{"1min":0.885,"5min":0.885,"15min":0.885},"max":{"1min":244.595,"5min":244.595,"15min":244.595},"last":1.625},{"interface":"front","average":{"1min":1.169,"5min":1.300,"15min":1.322},"min":{"1min":0.801,"5min":0.801,"15min":0.801},"max":{"1min":1.426,"5min":2.098,"15min":2.098},"last":1.033}]},{"osd":6,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.734,"15min":1.776},"min":{"1min":1.168,"5min":1.168,"15min":1.168},"max":{"1min":1.750,"5min":4.278,"15min":4.278},"last":1.584},{"interface":"front","average":{"1min":1.567,"5min":1.578,"15min":1.580},"min":{"1min":1.336,"5min":1.036,"15min":1.036},"max":{"1min":1.828,"5min":2.868,"15min":2.868},"last":1.786}]},{"osd":7,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":1.470,"5min":1.725,"15min":1.767},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":1.702,"5min":4.383,"15min":4.383},"last":1.867},{"interface":"front","average":{"1min":42.251,"5min":9.699,"15min":4.273},"min":{"1min":0.946,"5min":0.823,"15min":0.823},"max":{"1min":857.161,"5min":857.161,"15min":857.161},"last":1.464}]},{"osd":8,"last update":"Sun Dec 22 22:31:10 2019","interfaces":[{"interface":"back","average":{"1min":1.572,"5min":1.904,"15min":1.960},"min":{"1min":1.302,"5min":1.008,"15min":1.008},"max":{"1min":1.909,"5min":5.958,"15min":5.958},"last":1.829},{"interface":"front","average":{"1min":1.311,"5min":8.433,"15min":9.620},"min":{"1min":1.011,"5min":0.935,"15min":0.935},"max":{"1min":1.601,"5min":137.259,"15min":137.259},"last":1.547}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":1.766,"15min":1.766},"min":{"1min":1.228,"5min":1.228,"15min":1.228},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.906},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":2.753,"5min":2.753,"15min":2.753},"last":1.338}]}]},{"osd":8,"up_from":47,"seq":201863462947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.914,"5min":0.927,"15min":0.929},"min":{"1min":0.516,"5min":0.471,"15min":0.471},"max":{"1min":1.450,"5min":1.640,"15min":1.640},"last":1.097},{"interface":"front","average":{"1min":0.960,"5min":0.924,"15min":0.918},"min":{"1min":0.527,"5min":0.527,"15min":0.527},"max":{"1min":1.607,"5min":1.841,"15min":1.841},"last":0.830}]},{"osd":1,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":15.598,"5min":27.074,"15min":28.987},"min":{"1min":0.686,"5min":0.556,"15min":0.556},"max":{"1min":291.598,"5min":503.201,"15min":503.201},"last":0.996},{"interface":"front","average":{"1min":1.076,"5min":23.305,"15min":27.010},"min":{"1min":0.473,"5min":0.451,"15min":0.451},"max":{"1min":1.652,"5min":502.942,"15min":502.942},"last":0.756}]},{"osd":2,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.900,"5min":0.972,"15min":0.984},"min":{"1min":0.470,"5min":0.470,"15min":0.470},"max":{"1min":1.506,"5min":1.620,"15min":1.620},"last":0.696},{"interface":"front","average":{"1min":1.076,"5min":1.200,"15min":1.221},"min":{"1min":0.583,"5min":0.550,"15min":0.550},"max":{"1min":1.833,"5min":4.085,"15min":4.085},"last":1.156}]},{"osd":3,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.118,"5min":1.210,"15min":1.225},"min":{"1min":0.657,"5min":0.657,"15min":0.657},"max":{"1min":2.076,"5min":2.106,"15min":2.106},"last":0.946},{"interface":"front","average":{"1min":1.038,"5min":1.138,"15min":1.154},"min":{"1min":0.598,"5min":0.598,"15min":0.598},"max":{"1min":1.590,"5min":2.000,"15min":2.000},"last":1.390}]},{"osd":4,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.215,"5min":1.231,"15min":1.233},"min":{"1min":0.685,"5min":0.661,"15min":0.661},"max":{"1min":1.876,"5min":2.171,"15min":2.171},"last":1.265},{"interface":"front","average":{"1min":46.986,"5min":10.675,"15min":4.623},"min":{"1min":0.648,"5min":0.648,"15min":0.648},"max":{"1min":965.121,"5min":965.121,"15min":965.121},"last":0.892}]},{"osd":5,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.398,"5min":1.592,"15min":1.624},"min":{"1min":0.765,"5min":0.765,"15min":0.765},"max":{"1min":1.897,"5min":4.220,"15min":4.220},"last":1.475},{"interface":"front","average":{"1min":1.379,"5min":1.441,"15min":1.451},"min":{"1min":0.807,"5min":0.677,"15min":0.677},"max":{"1min":1.805,"5min":2.262,"15min":2.262},"last":1.425}]},{"osd":6,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.527,"15min":1.594},"min":{"1min":0.645,"5min":0.645,"15min":0.645},"max":{"1min":1.798,"5min":8.757,"15min":8.757},"last":1.056},{"interface":"front","average":{"1min":4.965,"5min":2.294,"15min":1.849},"min":{"1min":0.719,"5min":0.719,"15min":0.719},"max":{"1min":77.942,"5min":77.942,"15min":77.942},"last":1.320}]},{"osd":7,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.476,"15min":1.474},"min":{"1min":1.200,"5min":0.950,"15min":0.950},"max":{"1min":2.124,"5min":2.409,"15min":2.409},"last":1.517},{"interface":"front","average":{"1min":1.610,"5min":1.902,"15min":1.951},"min":{"1min":1.296,"5min":0.984,"15min":0.984},"max":{"1min":2.329,"5min":8.832,"15min":8.832},"last":1.551}]},{"osd":9,"last update":"Sun Dec 22 22:31:12 2019","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.907,"5min":0.907,"15min":0.907},"max":{"1min":2.035,"5min":2.528,"15min":2.528},"last":1.612},{"interface":"front","average":{"1min":1.321,"5min":1.377,"15min":1.387},"min":{"1min":0.943,"5min":0.769,"15min":0.769},"max":{"1min":1.528,"5min":2.219,"15min":2.219},"last":1.214}]},{"osd":10,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.740,"5min":0.740,"15min":0.740},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.359},{"interface":"front","average":{"1min":1.616,"5min":1.616,"15min":1.616},"min":{"1min":1.010,"5min":1.010,"15min":1.010},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.683}]}]},{"osd":7,"up_from":42,"seq":180388626469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.114,"15min":1.124},"min":{"1min":0.720,"5min":0.605,"15min":0.605},"max":{"1min":1.383,"5min":1.864,"15min":1.864},"last":0.870},{"interface":"front","average":{"1min":1.190,"5min":1.127,"15min":1.117},"min":{"1min":0.714,"5min":0.707,"15min":0.707},"max":{"1min":1.578,"5min":1.594,"15min":1.594},"last":1.103}]},{"osd":1,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":51.076,"5min":11.162,"15min":4.510},"min":{"1min":0.656,"5min":0.656,"15min":0.656},"max":{"1min":851.679,"5min":851.679,"15min":851.679},"last":0.546},{"interface":"front","average":{"1min":1.072,"5min":1.038,"15min":1.032},"min":{"1min":0.615,"5min":0.615,"15min":0.615},"max":{"1min":1.505,"5min":1.637,"15min":1.637},"last":0.825}]},{"osd":2,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.024,"15min":1.029},"min":{"1min":0.652,"5min":0.652,"15min":0.652},"max":{"1min":1.369,"5min":1.565,"15min":1.565},"last":0.916},{"interface":"front","average":{"1min":1.071,"5min":23.176,"15min":26.860},"min":{"1min":0.695,"5min":0.685,"15min":0.685},"max":{"1min":1.436,"5min":579.355,"15min":579.355},"last":1.043}]},{"osd":3,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":35.627,"5min":8.027,"15min":3.427},"min":{"1min":0.702,"5min":0.668,"15min":0.668},"max":{"1min":588.429,"5min":588.429,"15min":588.429},"last":0.759},{"interface":"front","average":{"1min":1.047,"5min":2.209,"15min":2.403},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.362,"5min":28.026,"15min":28.026},"last":0.997}]},{"osd":4,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.074,"5min":1.039,"15min":1.033},"min":{"1min":0.813,"5min":0.546,"15min":0.546},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.724},{"interface":"front","average":{"1min":1.067,"5min":1.035,"15min":1.029},"min":{"1min":0.563,"5min":0.563,"15min":0.563},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.147}]},{"osd":5,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.223,"5min":1.308,"15min":1.322},"min":{"1min":0.648,"5min":0.648,"15min":0.648},"max":{"1min":1.701,"5min":2.001,"15min":2.001},"last":1.212},{"interface":"front","average":{"1min":1.363,"5min":9.607,"15min":10.981},"min":{"1min":1.005,"5min":1.005,"15min":1.005},"max":{"1min":1.657,"5min":217.508,"15min":217.508},"last":1.249}]},{"osd":6,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.366,"5min":1.353,"15min":1.351},"min":{"1min":0.856,"5min":0.856,"15min":0.856},"max":{"1min":1.621,"5min":1.943,"15min":1.943},"last":0.967},{"interface":"front","average":{"1min":1.229,"5min":1.258,"15min":1.263},"min":{"1min":0.836,"5min":0.696,"15min":0.696},"max":{"1min":1.607,"5min":1.749,"15min":1.749},"last":1.188}]},{"osd":8,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.473,"5min":1.517,"15min":1.524},"min":{"1min":0.903,"5min":0.903,"15min":0.903},"max":{"1min":1.882,"5min":1.883,"15min":1.883},"last":1.392},{"interface":"front","average":{"1min":56.141,"5min":12.489,"15min":5.213},"min":{"1min":1.313,"5min":1.313,"15min":1.313},"max":{"1min":929.400,"5min":929.400,"15min":929.400},"last":1.493}]},{"osd":9,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":91.448,"5min":19.552,"15min":7.569},"min":{"1min":0.972,"5min":0.972,"15min":0.972},"max":{"1min":993.911,"5min":993.911,"15min":993.911},"last":1.319},{"interface":"front","average":{"1min":1.593,"5min":1.639,"15min":1.647},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":1.843,"5min":1.892,"15min":1.892},"last":1.429}]},{"osd":10,"last update":"Sun Dec 22 22:30:29 2019","interfaces":[{"interface":"back","average":{"1min":1.604,"5min":1.604,"15min":1.604},"min":{"1min":1.199,"5min":1.199,"15min":1.199},"max":{"1min":1.951,"5min":1.951,"15min":1.951},"last":1.355},{"interface":"front","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":1.441,"5min":1.441,"15min":1.441},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.460}]}]},{"osd":6,"up_from":37,"seq":158913789992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.182,"5min":1.189,"15min":1.195},"min":{"1min":0.798,"5min":0.644,"15min":0.644},"max":{"1min":1.646,"5min":1.877,"15min":1.877},"last":1.427},{"interface":"front","average":{"1min":0.997,"5min":1.031,"15min":1.039},"min":{"1min":0.607,"5min":0.607,"15min":0.607},"max":{"1min":1.414,"5min":1.905,"15min":1.905},"last":0.965}]},{"osd":1,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.055,"15min":1.002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.511,"5min":2.130,"15min":2.130},"last":0.869},{"interface":"front","average":{"1min":1.026,"5min":3.041,"15min":1.677},"min":{"1min":0.652,"5min":0.554,"15min":0.554},"max":{"1min":1.605,"5min":215.806,"15min":215.806},"last":1.143}]},{"osd":2,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":47.962,"5min":44.903,"15min":53.978},"min":{"1min":0.711,"5min":0.673,"15min":0.673},"max":{"1min":892.790,"5min":892.790,"15min":892.790},"last":0.819},{"interface":"front","average":{"1min":20.589,"5min":4.995,"15min":2.394},"min":{"1min":0.756,"5min":0.622,"15min":0.622},"max":{"1min":368.137,"5min":368.137,"15min":368.137},"last":1.498}]},{"osd":3,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.009,"15min":1.018},"min":{"1min":0.588,"5min":0.588,"15min":0.588},"max":{"1min":1.348,"5min":1.772,"15min":1.772},"last":1.298},{"interface":"front","average":{"1min":1.102,"5min":1.053,"15min":1.041},"min":{"1min":0.728,"5min":0.682,"15min":0.682},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.728}]},{"osd":4,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.034,"15min":1.011},"min":{"1min":0.676,"5min":0.544,"15min":0.544},"max":{"1min":1.647,"5min":1.920,"15min":1.920},"last":1.627},{"interface":"front","average":{"1min":28.459,"5min":6.490,"15min":2.812},"min":{"1min":0.578,"5min":0.540,"15min":0.540},"max":{"1min":523.313,"5min":523.313,"15min":523.313},"last":1.098}]},{"osd":5,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.193,"5min":1.224,"15min":1.230},"min":{"1min":0.910,"5min":0.602,"15min":0.602},"max":{"1min":1.482,"5min":2.279,"15min":2.279},"last":1.383},{"interface":"front","average":{"1min":30.914,"5min":7.363,"15min":3.445},"min":{"1min":1.073,"5min":0.958,"15min":0.958},"max":{"1min":560.624,"5min":560.624,"15min":560.624},"last":1.731}]},{"osd":7,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.435,"5min":1.350,"15min":1.336},"min":{"1min":0.638,"5min":0.638,"15min":0.638},"max":{"1min":1.963,"5min":1.963,"15min":1.963},"last":1.800},{"interface":"front","average":{"1min":1.242,"5min":1.248,"15min":1.249},"min":{"1min":0.834,"5min":0.834,"15min":0.834},"max":{"1min":1.780,"5min":1.780,"15min":1.780},"last":1.036}]},{"osd":8,"last update":"Sun Dec 22 22:30:51 2019","interfaces":[{"interface":"back","average":{"1min":43.697,"5min":9.814,"15min":4.167},"min":{"1min":0.940,"5min":0.873,"15min":0.873},"max":{"1min":449.604,"5min":449.604,"15min":449.604},"last":1.248},{"interface":"front","average":{"1min":30.044,"5min":7.260,"15min":3.462},"min":{"1min":1.353,"5min":1.272,"15min":1.272},"max":{"1min":596.398,"5min":596.398,"15min":596.398},"last":1.900}]},{"osd":9,"last update":"Sun Dec 22 22:31:08 2019","interfaces":[{"interface":"back","average":{"1min":1.676,"5min":1.691,"15min":1.693},"min":{"1min":1.235,"5min":1.235,"15min":1.235},"max":{"1min":2.301,"5min":2.784,"15min":2.784},"last":1.940},{"interface":"front","average":{"1min":1.488,"5min":1.464,"15min":1.460},"min":{"1min":0.978,"5min":0.978,"15min":0.978},"max":{"1min":2.132,"5min":2.132,"15min":2.132},"last":1.562}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.533,"15min":1.533},"min":{"1min":1.188,"5min":1.188,"15min":1.188},"max":{"1min":2.030,"5min":2.030,"15min":2.030},"last":1.674},{"interface":"front","average":{"1min":14.761,"5min":14.761,"15min":14.761},"min":{"1min":1.040,"5min":1.040,"15min":1.040},"max":{"1min":279.809,"5min":279.809,"15min":279.809},"last":1.360}]}]},{"osd":1,"up_from":12,"seq":51539607612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":0.799,"5min":4.913,"15min":1.997},"min":{"1min":0.481,"5min":0.301,"15min":0.301},"max":{"1min":2.181,"5min":447.710,"15min":447.710},"last":1.077},{"interface":"front","average":{"1min":31.591,"5min":6.856,"15min":2.701},"min":{"1min":0.520,"5min":0.337,"15min":0.337},"max":{"1min":522.718,"5min":522.718,"15min":522.718},"last":0.608}]},{"osd":2,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":0.868,"5min":0.749,"15min":0.698},"min":{"1min":0.582,"5min":0.431,"15min":0.431},"max":{"1min":1.490,"5min":1.490,"15min":1.490},"last":0.657},{"interface":"front","average":{"1min":0.860,"5min":0.746,"15min":0.701},"min":{"1min":0.515,"5min":0.496,"15min":0.496},"max":{"1min":1.336,"5min":1.336,"15min":1.336},"last":0.943}]},{"osd":3,"last update":"Sun Dec 22 22:30:20 2019","interfaces":[{"interface":"back","average":{"1min":0.850,"5min":0.789,"15min":0.771},"min":{"1min":0.534,"5min":0.534,"15min":0.534},"max":{"1min":1.428,"5min":1.428,"15min":1.428},"last":1.123},{"interface":"front","average":{"1min":0.991,"5min":7.186,"15min":3.012},"min":{"1min":0.723,"5min":0.691,"15min":0.691},"max":{"1min":1.316,"5min":686.743,"15min":686.743},"last":1.197}]},{"osd":4,"last update":"Sun Dec 22 22:30:35 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":1.008,"15min":0.979},"min":{"1min":0.750,"5min":0.488,"15min":0.488},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.637},{"interface":"front","average":{"1min":51.506,"5min":11.073,"15min":4.301},"min":{"1min":0.765,"5min":0.710,"15min":0.710},"max":{"1min":856.751,"5min":856.751,"15min":856.751},"last":1.223}]},{"osd":5,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":1.257,"5min":1.102,"15min":1.053},"min":{"1min":0.657,"5min":0.657,"15min":0.657},"max":{"1min":2.315,"5min":2.315,"15min":2.315},"last":0.817},{"interface":"front","average":{"1min":1.255,"5min":1.143,"15min":1.107},"min":{"1min":0.931,"5min":0.768,"15min":0.768},"max":{"1min":1.822,"5min":1.822,"15min":1.822},"last":1.165}]},{"osd":6,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":1.227,"5min":5.041,"15min":2.425},"min":{"1min":0.686,"5min":0.678,"15min":0.678},"max":{"1min":1.636,"5min":350.575,"15min":350.575},"last":1.417},{"interface":"front","average":{"1min":1.210,"5min":1.194,"15min":1.168},"min":{"1min":0.818,"5min":0.752,"15min":0.752},"max":{"1min":1.726,"5min":2.022,"15min":2.022},"last":1.522}]},{"osd":7,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":50.092,"5min":11.052,"15min":4.546},"min":{"1min":0.661,"5min":0.661,"15min":0.661},"max":{"1min":830.970,"5min":830.970,"15min":830.970},"last":1.360},{"interface":"front","average":{"1min":1.229,"5min":1.322,"15min":1.338},"min":{"1min":0.868,"5min":0.868,"15min":0.868},"max":{"1min":1.679,"5min":2.080,"15min":2.080},"last":1.325}]},{"osd":8,"last update":"Sun Dec 22 22:30:53 2019","interfaces":[{"interface":"back","average":{"1min":31.817,"5min":58.579,"15min":63.039},"min":{"1min":0.990,"5min":0.894,"15min":0.894},"max":{"1min":487.747,"5min":993.474,"15min":993.474},"last":1.489},{"interface":"front","average":{"1min":34.569,"5min":8.068,"15min":3.651},"min":{"1min":1.040,"5min":1.040,"15min":1.040},"max":{"1min":532.136,"5min":532.136,"15min":532.136},"last":1.397}]},{"osd":9,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":31.563,"15min":36.601},"min":{"1min":0.843,"5min":0.843,"15min":0.843},"max":{"1min":1.655,"5min":715.827,"15min":715.827},"last":1.462},{"interface":"front","average":{"1min":1.243,"5min":1.343,"15min":1.360},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":2.475,"5min":2.475,"15min":2.475},"last":0.876}]},{"osd":10,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.102,"5min":2.102,"15min":2.102},"last":473.752},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":1.213,"5min":1.213,"15min":1.213},"max":{"1min":2.140,"5min":2.140,"15min":2.140},"last":1.549}]}]},{"osd":0,"up_from":7,"seq":30064771137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":0.792,"5min":1.323,"15min":0.793},"min":{"1min":0.493,"5min":0.346,"15min":0.346},"max":{"1min":1.382,"5min":68.607,"15min":68.607},"last":640.014},{"interface":"front","average":{"1min":19.114,"5min":4.388,"15min":1.857},"min":{"1min":0.583,"5min":0.404,"15min":0.404},"max":{"1min":381.781,"5min":381.781,"15min":381.781},"last":0.783}]},{"osd":2,"last update":"Sun Dec 22 22:28:51 2019","interfaces":[{"interface":"back","average":{"1min":23.953,"5min":5.351,"15min":2.251},"min":{"1min":0.488,"5min":0.444,"15min":0.444},"max":{"1min":501.694,"5min":501.694,"15min":501.694},"last":1.446},{"interface":"front","average":{"1min":22.535,"5min":5.030,"15min":2.112},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":501.287,"5min":501.287,"15min":501.287},"last":0.805}]},{"osd":3,"last update":"Sun Dec 22 22:30:15 2019","interfaces":[{"interface":"back","average":{"1min":0.912,"5min":0.755,"15min":0.696},"min":{"1min":0.593,"5min":0.523,"15min":0.523},"max":{"1min":1.483,"5min":1.483,"15min":1.483},"last":0.914},{"interface":"front","average":{"1min":31.437,"5min":6.969,"15min":2.875},"min":{"1min":0.564,"5min":0.564,"15min":0.564},"max":{"1min":548.602,"5min":548.602,"15min":548.602},"last":1.164}]},{"osd":4,"last update":"Sun Dec 22 22:30:36 2019","interfaces":[{"interface":"back","average":{"1min":1.130,"5min":1.103,"15min":1.091},"min":{"1min":0.787,"5min":0.680,"15min":0.680},"max":{"1min":1.773,"5min":2.152,"15min":2.152},"last":1.298},{"interface":"front","average":{"1min":1.056,"5min":16.051,"15min":6.020},"min":{"1min":0.723,"5min":0.723,"15min":0.723},"max":{"1min":1.526,"5min":995.256,"15min":995.256},"last":0.680}]},{"osd":5,"last update":"Sun Dec 22 22:30:56 2019","interfaces":[{"interface":"back","average":{"1min":1.290,"5min":1.155,"15min":1.111},"min":{"1min":0.864,"5min":0.819,"15min":0.819},"max":{"1min":1.933,"5min":1.933,"15min":1.933},"last":1.133},{"interface":"front","average":{"1min":35.092,"5min":7.988,"15min":3.436},"min":{"1min":0.793,"5min":0.671,"15min":0.671},"max":{"1min":677.586,"5min":677.586,"15min":677.586},"last":1.678}]},{"osd":6,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.364,"5min":1.238,"15min":1.217},"min":{"1min":0.733,"5min":0.709,"15min":0.709},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.629},{"interface":"front","average":{"1min":1.261,"5min":1.236,"15min":1.232},"min":{"1min":0.805,"5min":0.805,"15min":0.805},"max":{"1min":1.733,"5min":1.733,"15min":1.733},"last":0.856}]},{"osd":7,"last update":"Sun Dec 22 22:30:30 2019","interfaces":[{"interface":"back","average":{"1min":1.324,"5min":1.251,"15min":1.239},"min":{"1min":0.891,"5min":0.827,"15min":0.827},"max":{"1min":1.935,"5min":1.935,"15min":1.935},"last":1.266},{"interface":"front","average":{"1min":1.424,"5min":1.290,"15min":1.268},"min":{"1min":1.002,"5min":0.957,"15min":0.957},"max":{"1min":2.098,"5min":2.098,"15min":2.098},"last":1.407}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.553,"5min":1.544,"15min":1.542},"min":{"1min":1.185,"5min":0.964,"15min":0.964},"max":{"1min":2.131,"5min":2.341,"15min":2.341},"last":1.739},{"interface":"front","average":{"1min":1.462,"5min":1.435,"15min":1.431},"min":{"1min":0.856,"5min":0.856,"15min":0.856},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1.225}]},{"osd":9,"last update":"Sun Dec 22 22:30:11 2019","interfaces":[{"interface":"back","average":{"1min":1.592,"5min":1.592,"15min":1.592},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.544},{"interface":"front","average":{"1min":1.483,"5min":1.483,"15min":1.483},"min":{"1min":0.974,"5min":0.974,"15min":0.974},"max":{"1min":2.280,"5min":2.280,"15min":2.280},"last":1.506}]},{"osd":10,"last update":"Sun Dec 22 22:30:28 2019","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":2.408,"5min":2.408,"15min":2.408},"last":1.798},{"interface":"front","average":{"1min":1.477,"5min":1.477,"15min":1.477},"min":{"1min":0.889,"5min":0.889,"15min":0.889},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.362}]},{"osd":11,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":23.924,"5min":23.924,"15min":23.924},"min":{"1min":1.013,"5min":1.013,"15min":1.013},"max":{"1min":467.930,"5min":467.930,"15min":467.930},"last":1.581},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":1.242,"5min":1.242,"15min":1.242},"max":{"1min":2.114,"5min":2.114,"15min":2.114},"last":1.337}]}]},{"osd":2,"up_from":17,"seq":73014444088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":0.884,"5min":0.707,"15min":0.617},"min":{"1min":0.411,"5min":0.411,"15min":0.411},"max":{"1min":1.677,"5min":1.863,"15min":1.863},"last":1.347},{"interface":"front","average":{"1min":0.934,"5min":3.822,"15min":1.704},"min":{"1min":0.539,"5min":0.315,"15min":0.315},"max":{"1min":1.642,"5min":272.186,"15min":272.186},"last":0.968}]},{"osd":1,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":0.953,"5min":4.723,"15min":1.993},"min":{"1min":0.438,"5min":0.391,"15min":0.391},"max":{"1min":1.821,"5min":357.558,"15min":357.558},"last":1.159},{"interface":"front","average":{"1min":0.953,"5min":0.834,"15min":0.716},"min":{"1min":0.492,"5min":0.390,"15min":0.390},"max":{"1min":2.259,"5min":2.259,"15min":2.259},"last":1.061}]},{"osd":3,"last update":"Sun Dec 22 22:31:16 2019","interfaces":[{"interface":"back","average":{"1min":0.948,"5min":0.920,"15min":0.874},"min":{"1min":0.491,"5min":0.491,"15min":0.491},"max":{"1min":1.554,"5min":2.182,"15min":2.182},"last":1.238},{"interface":"front","average":{"1min":0.917,"5min":0.795,"15min":0.721},"min":{"1min":0.540,"5min":0.484,"15min":0.484},"max":{"1min":1.820,"5min":1.820,"15min":1.820},"last":0.708}]},{"osd":4,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.122,"5min":1.053,"15min":1.031},"min":{"1min":0.666,"5min":0.666,"15min":0.666},"max":{"1min":2.111,"5min":2.111,"15min":2.111},"last":1.023},{"interface":"front","average":{"1min":1.253,"5min":1.062,"15min":1.018},"min":{"1min":0.931,"5min":0.664,"15min":0.664},"max":{"1min":2.045,"5min":2.045,"15min":2.045},"last":1.470}]},{"osd":5,"last update":"Sun Dec 22 22:30:58 2019","interfaces":[{"interface":"back","average":{"1min":50.784,"5min":13.329,"15min":7.725},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":944.730,"5min":944.730,"15min":944.730},"last":0.866},{"interface":"front","average":{"1min":1.290,"5min":1.148,"15min":1.106},"min":{"1min":0.671,"5min":0.671,"15min":0.671},"max":{"1min":2.526,"5min":2.526,"15min":2.526},"last":1.510}]},{"osd":6,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.234,"15min":1.239},"min":{"1min":0.787,"5min":0.743,"15min":0.743},"max":{"1min":1.761,"5min":2.381,"15min":2.381},"last":1.432},{"interface":"front","average":{"1min":1.232,"5min":1.248,"15min":1.250},"min":{"1min":0.757,"5min":0.757,"15min":0.757},"max":{"1min":1.929,"5min":2.467,"15min":2.467},"last":0.895}]},{"osd":7,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":1.487,"5min":1.336,"15min":1.311},"min":{"1min":0.860,"5min":0.860,"15min":0.860},"max":{"1min":2.811,"5min":2.811,"15min":2.811},"last":1.681},{"interface":"front","average":{"1min":1.588,"5min":17.128,"15min":19.718},"min":{"1min":1.030,"5min":1.030,"15min":1.030},"max":{"1min":2.874,"5min":412.794,"15min":412.794},"last":1.742}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.382,"5min":1.450,"15min":1.461},"min":{"1min":0.632,"5min":0.632,"15min":0.632},"max":{"1min":2.672,"5min":2.672,"15min":2.672},"last":1.317},{"interface":"front","average":{"1min":1.487,"5min":1.378,"15min":1.360},"min":{"1min":0.690,"5min":0.690,"15min":0.690},"max":{"1min":2.420,"5min":2.420,"15min":2.420},"last":1.713}]},{"osd":9,"last update":"Sun Dec 22 22:31:11 2019","interfaces":[{"interface":"back","average":{"1min":40.612,"5min":9.244,"15min":4.016},"min":{"1min":0.934,"5min":0.890,"15min":0.890},"max":{"1min":667.949,"5min":667.949,"15min":667.949},"last":1.119},{"interface":"front","average":{"1min":1.485,"5min":1.521,"15min":1.527},"min":{"1min":0.818,"5min":0.818,"15min":0.818},"max":{"1min":1.956,"5min":2.619,"15min":2.619},"last":1.647}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":54.553,"5min":54.553,"15min":54.553},"min":{"1min":1.147,"5min":1.147,"15min":1.147},"max":{"1min":501.863,"5min":501.863,"15min":501.863},"last":1.402},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.704,"5min":2.704,"15min":2.704},"last":1.775}]}]},{"osd":3,"up_from":22,"seq":94489280565,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:29:14 2019","interfaces":[{"interface":"back","average":{"1min":0.843,"5min":0.692,"15min":0.667},"min":{"1min":0.625,"5min":0.474,"15min":0.474},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.609},{"interface":"front","average":{"1min":0.867,"5min":0.742,"15min":0.721},"min":{"1min":0.556,"5min":0.527,"15min":0.527},"max":{"1min":1.555,"5min":1.555,"15min":1.555},"last":0.707}]},{"osd":1,"last update":"Sun Dec 22 22:30:18 2019","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.797,"15min":0.784},"min":{"1min":0.415,"5min":0.415,"15min":0.415},"max":{"1min":1.527,"5min":1.527,"15min":1.527},"last":0.733},{"interface":"front","average":{"1min":0.922,"5min":5.827,"15min":2.559},"min":{"1min":0.511,"5min":0.511,"15min":0.511},"max":{"1min":3.372,"5min":467.732,"15min":467.732},"last":0.578}]},{"osd":2,"last update":"Sun Dec 22 22:30:18 2019","interfaces":[{"interface":"back","average":{"1min":29.972,"5min":6.561,"15min":2.632},"min":{"1min":0.485,"5min":0.485,"15min":0.485},"max":{"1min":667.845,"5min":667.845,"15min":667.845},"last":0.686},{"interface":"front","average":{"1min":0.948,"5min":0.829,"15min":0.776},"min":{"1min":0.523,"5min":0.455,"15min":0.455},"max":{"1min":1.940,"5min":1.940,"15min":1.940},"last":0.952}]},{"osd":4,"last update":"Sun Dec 22 22:30:37 2019","interfaces":[{"interface":"back","average":{"1min":1.265,"5min":1.121,"15min":1.067},"min":{"1min":0.772,"5min":0.652,"15min":0.652},"max":{"1min":2.961,"5min":2.961,"15min":2.961},"last":0.999},{"interface":"front","average":{"1min":1.312,"5min":1.158,"15min":1.102},"min":{"1min":0.886,"5min":0.750,"15min":0.750},"max":{"1min":2.845,"5min":2.845,"15min":2.845},"last":1.126}]},{"osd":5,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":0.974,"5min":1.756,"15min":1.998},"min":{"1min":0.609,"5min":0.609,"15min":0.609},"max":{"1min":1.561,"5min":24.295,"15min":24.295},"last":1.043},{"interface":"front","average":{"1min":1.131,"5min":1.160,"15min":1.118},"min":{"1min":0.776,"5min":0.776,"15min":0.776},"max":{"1min":1.786,"5min":2.312,"15min":2.312},"last":0.896}]},{"osd":6,"last update":"Sun Dec 22 22:30:12 2019","interfaces":[{"interface":"back","average":{"1min":36.679,"5min":8.283,"15min":3.551},"min":{"1min":0.850,"5min":0.850,"15min":0.850},"max":{"1min":501.935,"5min":501.935,"15min":501.935},"last":1.432},{"interface":"front","average":{"1min":1.414,"5min":1.308,"15min":1.290},"min":{"1min":0.647,"5min":0.647,"15min":0.647},"max":{"1min":2.155,"5min":2.155,"15min":2.155},"last":1.176}]},{"osd":7,"last update":"Sun Dec 22 22:30:37 2019","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.387,"15min":1.393},"min":{"1min":0.804,"5min":0.804,"15min":0.804},"max":{"1min":3.156,"5min":3.156,"15min":3.156},"last":1.275},{"interface":"front","average":{"1min":1.261,"5min":1.340,"15min":1.353},"min":{"1min":0.650,"5min":0.650,"15min":0.650},"max":{"1min":2.523,"5min":2.523,"15min":2.523},"last":1.307}]},{"osd":8,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":1.320,"5min":34.304,"15min":39.801},"min":{"1min":0.811,"5min":0.811,"15min":0.811},"max":{"1min":1.970,"5min":820.143,"15min":820.143},"last":1.591},{"interface":"front","average":{"1min":15.298,"5min":4.367,"15min":2.545},"min":{"1min":0.840,"5min":0.840,"15min":0.840},"max":{"1min":292.729,"5min":292.729,"15min":292.729},"last":1.405}]},{"osd":9,"last update":"Sun Dec 22 22:31:11 2019","interfaces":[{"interface":"back","average":{"1min":21.370,"5min":5.570,"15min":2.936},"min":{"1min":0.926,"5min":0.926,"15min":0.926},"max":{"1min":321.219,"5min":321.219,"15min":321.219},"last":321.219},{"interface":"front","average":{"1min":1.253,"5min":1.530,"15min":1.576},"min":{"1min":0.862,"5min":0.862,"15min":0.862},"max":{"1min":1.686,"5min":3.233,"15min":3.233},"last":1.371}]},{"osd":10,"last update":"Sun Dec 22 22:30:31 2019","interfaces":[{"interface":"back","average":{"1min":15.340,"5min":15.340,"15min":15.340},"min":{"1min":0.821,"5min":0.821,"15min":0.821},"max":{"1min":280.174,"5min":280.174,"15min":280.174},"last":1.552},{"interface":"front","average":{"1min":43.049,"5min":43.049,"15min":43.049},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":832.650,"5min":832.650,"15min":832.650},"last":1.482}]},{"osd":11,"last update":"Sun Dec 22 22:30:52 2019","interfaces":[{"interface":"back","average":{"1min":20.768,"5min":20.768,"15min":20.768},"min":{"1min":0.910,"5min":0.910,"15min":0.910},"max":{"1min":427.022,"5min":427.022,"15min":427.022},"last":1.648},{"interface":"front","average":{"1min":37.520,"5min":37.520,"15min":37.520},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":792.516,"5min":792.516,"15min":792.516},"last":1.508}]}]},{"osd":4,"up_from":27,"seq":115964117039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.055,"5min":1.073,"15min":1.069},"min":{"1min":0.652,"5min":0.649,"15min":0.649},"max":{"1min":1.479,"5min":1.942,"15min":1.942},"last":1.189},{"interface":"front","average":{"1min":1.173,"5min":1.107,"15min":1.098},"min":{"1min":0.824,"5min":0.721,"15min":0.721},"max":{"1min":1.620,"5min":1.876,"15min":1.876},"last":1.276}]},{"osd":1,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":0.977,"5min":0.935,"15min":0.905},"min":{"1min":0.603,"5min":0.580,"15min":0.580},"max":{"1min":1.453,"5min":1.546,"15min":1.546},"last":0.663},{"interface":"front","average":{"1min":1.038,"5min":3.901,"15min":1.927},"min":{"1min":0.678,"5min":0.629,"15min":0.629},"max":{"1min":1.547,"5min":277.064,"15min":277.064},"last":0.948}]},{"osd":2,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":15.435,"15min":21.785},"min":{"1min":0.827,"5min":0.757,"15min":0.757},"max":{"1min":1.636,"5min":430.289,"15min":430.289},"last":1.022},{"interface":"front","average":{"1min":37.352,"5min":18.552,"15min":6.938},"min":{"1min":0.926,"5min":0.743,"15min":0.743},"max":{"1min":831.842,"5min":967.982,"15min":967.982},"last":1.328}]},{"osd":3,"last update":"Sun Dec 22 22:30:38 2019","interfaces":[{"interface":"back","average":{"1min":1.156,"5min":1.050,"15min":1.015},"min":{"1min":0.762,"5min":0.585,"15min":0.585},"max":{"1min":1.521,"5min":1.728,"15min":1.728},"last":0.898},{"interface":"front","average":{"1min":1.029,"5min":10.775,"15min":4.207},"min":{"1min":0.670,"5min":0.636,"15min":0.636},"max":{"1min":1.518,"5min":929.402,"15min":929.402},"last":1.069}]},{"osd":5,"last update":"Sun Dec 22 22:30:56 2019","interfaces":[{"interface":"back","average":{"1min":1.140,"5min":1.002,"15min":0.962},"min":{"1min":0.713,"5min":0.509,"15min":0.509},"max":{"1min":1.563,"5min":1.905,"15min":1.905},"last":0.805},{"interface":"front","average":{"1min":1.331,"5min":1.114,"15min":1.056},"min":{"1min":0.613,"5min":0.484,"15min":0.484},"max":{"1min":1.683,"5min":1.683,"15min":1.683},"last":1.120}]},{"osd":6,"last update":"Sun Dec 22 22:30:16 2019","interfaces":[{"interface":"back","average":{"1min":84.896,"5min":17.852,"15min":6.678},"min":{"1min":0.782,"5min":0.680,"15min":0.680},"max":{"1min":529.309,"5min":529.309,"15min":529.309},"last":0.984},{"interface":"front","average":{"1min":1.195,"5min":1.243,"15min":1.251},"min":{"1min":0.825,"5min":0.600,"15min":0.600},"max":{"1min":1.645,"5min":1.707,"15min":1.707},"last":0.841}]},{"osd":7,"last update":"Sun Dec 22 22:30:34 2019","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.259,"15min":1.247},"min":{"1min":0.783,"5min":0.623,"15min":0.623},"max":{"1min":1.678,"5min":1.678,"15min":1.678},"last":0.721},{"interface":"front","average":{"1min":1.228,"5min":1.299,"15min":1.311},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.721,"5min":1.721,"15min":1.721},"last":0.764}]},{"osd":8,"last update":"Sun Dec 22 22:30:50 2019","interfaces":[{"interface":"back","average":{"1min":1.430,"5min":26.380,"15min":30.538},"min":{"1min":1.150,"5min":1.111,"15min":1.111},"max":{"1min":1.814,"5min":531.221,"15min":531.221},"last":1.526},{"interface":"front","average":{"1min":1.648,"5min":1.518,"15min":1.496},"min":{"1min":1.275,"5min":0.951,"15min":0.951},"max":{"1min":1.932,"5min":1.932,"15min":1.932},"last":1.500}]},{"osd":9,"last update":"Sun Dec 22 22:31:13 2019","interfaces":[{"interface":"back","average":{"1min":16.121,"5min":4.496,"15min":2.558},"min":{"1min":1.376,"5min":0.977,"15min":0.977},"max":{"1min":348.092,"5min":348.092,"15min":348.092},"last":1.447},{"interface":"front","average":{"1min":34.876,"5min":48.296,"15min":50.533},"min":{"1min":1.019,"5min":1.019,"15min":1.019},"max":{"1min":805.158,"5min":904.459,"15min":904.459},"last":1.247}]},{"osd":10,"last update":"Sun Dec 22 22:30:28 2019","interfaces":[{"interface":"back","average":{"1min":14.077,"5min":14.077,"15min":14.077},"min":{"1min":1.224,"5min":1.224,"15min":1.224},"max":{"1min":275.538,"5min":275.538,"15min":275.538},"last":1.690},{"interface":"front","average":{"1min":1.658,"5min":1.658,"15min":1.658},"min":{"1min":1.020,"5min":1.020,"15min":1.020},"max":{"1min":1.951,"5min":1.951,"15min":1.951},"last":1.529}]}]},{"osd":5,"up_from":32,"seq":137438953517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049144,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696008,"statfs":{"total":95995035648,"available":94920712192,"internally_reserved":1073741824,"allocated":573440,"data_stored":246579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":5.148,"5min":1.819,"15min":1.260},"min":{"1min":0.760,"5min":0.568,"15min":0.568},"max":{"1min":75.068,"5min":75.068,"15min":75.068},"last":11.424},{"interface":"front","average":{"1min":1.262,"5min":1.041,"15min":0.969},"min":{"1min":0.680,"5min":0.630,"15min":0.630},"max":{"1min":5.292,"5min":5.292,"15min":5.292},"last":11.537}]},{"osd":1,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.259,"5min":24.901,"15min":35.449},"min":{"1min":0.780,"5min":0.453,"15min":0.453},"max":{"1min":5.195,"5min":637.713,"15min":637.713},"last":11.239},{"interface":"front","average":{"1min":1.231,"5min":1.080,"15min":1.043},"min":{"1min":0.608,"5min":0.608,"15min":0.608},"max":{"1min":5.080,"5min":5.080,"15min":5.080},"last":11.341}]},{"osd":2,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.328,"5min":1.015,"15min":0.943},"min":{"1min":0.759,"5min":0.526,"15min":0.526},"max":{"1min":5.239,"5min":5.239,"15min":5.239},"last":11.594},{"interface":"front","average":{"1min":48.970,"5min":10.645,"15min":4.233},"min":{"1min":0.614,"5min":0.614,"15min":0.614},"max":{"1min":906.443,"5min":906.443,"15min":906.443},"last":11.471}]},{"osd":3,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":32.944,"5min":7.425,"15min":3.155},"min":{"1min":0.684,"5min":0.544,"15min":0.544},"max":{"1min":601.608,"5min":601.608,"15min":601.608},"last":11.493},{"interface":"front","average":{"1min":1.403,"5min":1.143,"15min":1.075},"min":{"1min":0.733,"5min":0.581,"15min":0.581},"max":{"1min":5.351,"5min":5.351,"15min":5.351},"last":11.184}]},{"osd":4,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.059,"5min":5.945,"15min":2.619},"min":{"1min":0.575,"5min":0.426,"15min":0.426},"max":{"1min":2.019,"5min":447.758,"15min":447.758},"last":0.813},{"interface":"front","average":{"1min":1.242,"5min":1.117,"15min":1.061},"min":{"1min":0.766,"5min":0.368,"15min":0.368},"max":{"1min":1.561,"5min":1.862,"15min":1.862},"last":0.885}]},{"osd":6,"last update":"Sun Dec 22 22:31:15 2019","interfaces":[{"interface":"back","average":{"1min":67.955,"5min":14.491,"15min":5.545},"min":{"1min":0.764,"5min":0.336,"15min":0.336},"max":{"1min":901.112,"5min":901.112,"15min":901.112},"last":901.112},{"interface":"front","average":{"1min":1.196,"5min":1.202,"15min":1.186},"min":{"1min":0.649,"5min":0.497,"15min":0.497},"max":{"1min":1.520,"5min":2.058,"15min":2.058},"last":0.942}]},{"osd":7,"last update":"Sun Dec 22 22:30:33 2019","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.285,"15min":1.266},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.023},{"interface":"front","average":{"1min":1.439,"5min":1.338,"15min":1.321},"min":{"1min":0.805,"5min":0.697,"15min":0.697},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.072}]},{"osd":8,"last update":"Sun Dec 22 22:30:54 2019","interfaces":[{"interface":"back","average":{"1min":1.533,"5min":1.507,"15min":1.503},"min":{"1min":0.895,"5min":0.895,"15min":0.895},"max":{"1min":1.842,"5min":2.214,"15min":2.214},"last":1.209},{"interface":"front","average":{"1min":1.473,"5min":1.465,"15min":1.463},"min":{"1min":1.043,"5min":1.014,"15min":1.014},"max":{"1min":2.236,"5min":2.258,"15min":2.258},"last":1.160}]},{"osd":9,"last update":"Sun Dec 22 22:31:14 2019","interfaces":[{"interface":"back","average":{"1min":1.549,"5min":1.560,"15min":1.562},"min":{"1min":1.011,"5min":1.011,"15min":1.011},"max":{"1min":2.154,"5min":2.172,"15min":2.172},"last":1.283},{"interface":"front","average":{"1min":56.194,"5min":57.118,"15min":57.272},"min":{"1min":1.261,"5min":1.261,"15min":1.261},"max":{"1min":781.391,"5min":781.391,"15min":781.391},"last":1.437}]},{"osd":10,"last update":"Sun Dec 22 22:30:33 2019","interfaces":[{"interface":"back","average":{"1min":1.596,"5min":1.596,"15min":1.596},"min":{"1min":1.132,"5min":1.132,"15min":1.132},"max":{"1min":2.338,"5min":2.338,"15min":2.338},"last":1.378},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.368,"5min":1.368,"15min":1.368},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.329}]}]}]}} 2019-12-22T22:31:21.496 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2019-12-22T22:31:21.496 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd dump 2019-12-22T22:31:23.645 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 78 2019-12-22T22:31:23.646 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 7a4dd340-2509-11ea-8284-001a4aab830c 2019-12-22T22:31:23.646 INFO:teuthology.orchestra.run.smithi071.stdout:created 2019-12-22T22:22:48.676390+0000 2019-12-22T22:31:23.646 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2019-12-22T22:31:11.942749+0000 2019-12-22T22:31:23.646 INFO:teuthology.orchestra.run.smithi071.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2019-12-22T22:31:23.646 INFO:teuthology.orchestra.run.smithi071.stdout:crush_version 25 2019-12-22T22:31:23.646 INFO:teuthology.orchestra.run.smithi071.stdout:full_ratio 0.95 2019-12-22T22:31:23.646 INFO:teuthology.orchestra.run.smithi071.stdout:backfillfull_ratio 0.9 2019-12-22T22:31:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:nearfull_ratio 0.85 2019-12-22T22:31:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:require_min_compat_client jewel 2019-12-22T22:31:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:min_compat_client jewel 2019-12-22T22:31:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:require_osd_release octopus 2019-12-22T22:31:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:max_osd 12 2019-12-22T22:31:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 up in weight 1 up_from 7 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.71:6801/1 v1:172.21.15.71:6802/1 exists,up 86ddcd9d-c925-411c-9d2e-7d613821a309 2019-12-22T22:31:23.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.71:6805/1 v1:172.21.15.71:6806/1 exists,up e04a3b24-9682-45c0-941e-864c366073d8 2019-12-22T22:31:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.71:6809/1 v1:172.21.15.71:6810/1 exists,up 0595079d-cd61-4a72-b8bf-44eb0a1ef481 2019-12-22T22:31:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.71:6813/1 v1:172.21.15.71:6814/1 exists,up fa5d9344-8667-46dd-93a7-a0684738d49d 2019-12-22T22:31:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 up in weight 1 up_from 27 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.187:6800/1 v1:172.21.15.187:6801/1 exists,up 9c910c75-dedc-4b7d-8f81-ba004d95a266 2019-12-22T22:31:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 up in weight 1 up_from 32 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.187:6804/1 v1:172.21.15.187:6805/1 exists,up f9702fa9-8a09-43bc-b759-3a4dfd381551 2019-12-22T22:31:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 up in weight 1 up_from 37 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.187:6808/1 v1:172.21.15.187:6809/1 exists,up 5fb32f24-707e-4b7c-8ed6-b5b44ec0903b 2019-12-22T22:31:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 up in weight 1 up_from 42 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.187:6812/1 v1:172.21.15.187:6813/1 exists,up 2da96598-0a1b-4efa-84df-d856fdcef32a 2019-12-22T22:31:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8 up in weight 1 up_from 47 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.168:6800/1 v1:172.21.15.168:6801/1 exists,up 4452d1c7-9eda-4248-ab44-0e4004193942 2019-12-22T22:31:23.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9 up in weight 1 up_from 52 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.168:6804/1 v1:172.21.15.168:6805/1 exists,up 1c07ce0a-aaec-4aba-914e-9c6c940f5467 2019-12-22T22:31:23.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10 up in weight 1 up_from 58 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.168:6808/1 v1:172.21.15.168:6809/1 exists,up 3734f370-31a4-43a2-9c3b-0a10280ac4a3 2019-12-22T22:31:23.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11 up in weight 1 up_from 64 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.168:6812/1 v1:172.21.15.168:6813/1 exists,up a0f20104-717f-4c4f-a79e-3a217b371eae 2019-12-22T22:31:23.649 INFO:teuthology.orchestra.run.smithi071.stdout:blacklist 172.21.15.71:6800/1 expires 2019-12-23T22:23:05.056165+0000 2019-12-22T22:31:24.285 INFO:tasks.cephadm.ceph_manager.ceph:['osd.0 up in weight 1 up_from 7 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.71:6801/1 v1:172.21.15.71:6802/1 exists,up 86ddcd9d-c925-411c-9d2e-7d613821a309', 'osd.1 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.71:6805/1 v1:172.21.15.71:6806/1 exists,up e04a3b24-9682-45c0-941e-864c366073d8', 'osd.2 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.71:6809/1 v1:172.21.15.71:6810/1 exists,up 0595079d-cd61-4a72-b8bf-44eb0a1ef481', 'osd.3 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.71:6813/1 v1:172.21.15.71:6814/1 exists,up fa5d9344-8667-46dd-93a7-a0684738d49d', 'osd.4 up in weight 1 up_from 27 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.187:6800/1 v1:172.21.15.187:6801/1 exists,up 9c910c75-dedc-4b7d-8f81-ba004d95a266', 'osd.5 up in weight 1 up_from 32 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.187:6804/1 v1:172.21.15.187:6805/1 exists,up f9702fa9-8a09-43bc-b759-3a4dfd381551', 'osd.6 up in weight 1 up_from 37 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.187:6808/1 v1:172.21.15.187:6809/1 exists,up 5fb32f24-707e-4b7c-8ed6-b5b44ec0903b', 'osd.7 up in weight 1 up_from 42 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.187:6812/1 v1:172.21.15.187:6813/1 exists,up 2da96598-0a1b-4efa-84df-d856fdcef32a', 'osd.8 up in weight 1 up_from 47 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.168:6800/1 v1:172.21.15.168:6801/1 exists,up 4452d1c7-9eda-4248-ab44-0e4004193942', 'osd.9 up in weight 1 up_from 52 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.168:6804/1 v1:172.21.15.168:6805/1 exists,up 1c07ce0a-aaec-4aba-914e-9c6c940f5467', 'osd.10 up in weight 1 up_from 58 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.168:6808/1 v1:172.21.15.168:6809/1 exists,up 3734f370-31a4-43a2-9c3b-0a10280ac4a3', 'osd.11 up in weight 1 up_from 64 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.168:6812/1 v1:172.21.15.168:6813/1 exists,up a0f20104-717f-4c4f-a79e-3a217b371eae'] 2019-12-22T22:31:24.286 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon mon.a config show 2019-12-22T22:31:26.319 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:31:26.320 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mon.a", 2019-12-22T22:31:26.320 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster": "ceph", 2019-12-22T22:31:26.320 INFO:teuthology.orchestra.run.smithi071.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2019-12-22T22:31:26.320 INFO:teuthology.orchestra.run.smithi071.stdout: "admin_socket_mode": "", 2019-12-22T22:31:26.320 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_ansi": "Terminal", 2019-12-22T22:31:26.320 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_client_required": "cephx, none", 2019-12-22T22:31:26.321 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_cluster_required": "cephx", 2019-12-22T22:31:26.321 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_debug": "true", 2019-12-22T22:31:26.321 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_mon_ticket_ttl": "43200.000000", 2019-12-22T22:31:26.321 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_service_required": "cephx", 2019-12-22T22:31:26.321 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_service_ticket_ttl": "3600.000000", 2019-12-22T22:31:26.321 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_supported": "", 2019-12-22T22:31:26.321 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio": "true", 2019-12-22T22:31:26.322 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio_max_queue_depth": "1024", 2019-12-22T22:31:26.322 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio_poll_ms": "250", 2019-12-22T22:31:26.322 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio_reap_max": "16", 2019-12-22T22:31:26.322 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_async_discard": "false", 2019-12-22T22:31:26.322 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_block_size": "4096", 2019-12-22T22:31:26.322 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_aio": "false", 2019-12-22T22:31:26.322 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_aio_log_age": "5.000000", 2019-12-22T22:31:26.323 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2019-12-22T22:31:26.323 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_inflight_ios": "false", 2019-12-22T22:31:26.323 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_enable_discard": "false", 2019-12-22T22:31:26.323 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_inject_crash": "0", 2019-12-22T22:31:26.323 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_inject_crash_flush_delay": "2", 2019-12-22T22:31:26.323 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_nvme_retry_count": "-1", 2019-12-22T22:31:26.323 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_nvme_unbind_from_kernel": "false", 2019-12-22T22:31:26.324 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_alloc_size": "1048576", 2019-12-22T22:31:26.324 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_allocator": "bitmap", 2019-12-22T22:31:26.324 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_buffered_io": "true", 2019-12-22T22:31:26.324 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_compact_log_sync": "false", 2019-12-22T22:31:26.324 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2019-12-22T22:31:26.325 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_log_compact_min_size": "16777216", 2019-12-22T22:31:26.325 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_log_replay_check_allocations": "true", 2019-12-22T22:31:26.326 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_max_log_runway": "4194304", 2019-12-22T22:31:26.326 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_max_prefetch": "1048576", 2019-12-22T22:31:26.326 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_min_flush_size": "524288", 2019-12-22T22:31:26.326 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_min_log_runway": "1048576", 2019-12-22T22:31:26.326 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_preextend_wal_files": "true", 2019-12-22T22:31:26.326 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_shared_alloc_size": "65536", 2019-12-22T22:31:26.326 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_sync_write": "false", 2019-12-22T22:31:26.327 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2019-12-22T22:31:26.327 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2019-12-22T22:31:26.327 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_allocator": "bitmap", 2019-12-22T22:31:26.327 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2019-12-22T22:31:26.327 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2019-12-22T22:31:26.327 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2019-12-22T22:31:26.327 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bitmapallocator_span_size": "1024", 2019-12-22T22:31:26.328 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blobid_prealloc": "10240", 2019-12-22T22:31:26.328 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_create": "true", 2019-12-22T22:31:26.328 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_db_create": "false", 2019-12-22T22:31:26.328 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_db_path": "", 2019-12-22T22:31:26.328 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_db_size": "0", 2019-12-22T22:31:26.328 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_path": "", 2019-12-22T22:31:26.328 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_preallocate_file": "false", 2019-12-22T22:31:26.329 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_size": "107374182400", 2019-12-22T22:31:26.329 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_wal_create": "false", 2019-12-22T22:31:26.329 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_wal_path": "", 2019-12-22T22:31:26.329 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_wal_size": "100663296", 2019-12-22T22:31:26.329 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs": "true", 2019-12-22T22:31:26.329 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2019-12-22T22:31:26.329 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_balance_interval": "1.000000", 2019-12-22T22:31:26.330 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_db_compatibility": "true", 2019-12-22T22:31:26.330 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_env_mirror": "false", 2019-12-22T22:31:26.330 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_gift_ratio": "0.020000", 2019-12-22T22:31:26.330 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_max_free": "10737418240", 2019-12-22T22:31:26.330 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_max_ratio": "0.900000", 2019-12-22T22:31:26.330 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_min": "1073741824", 2019-12-22T22:31:26.330 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_min_free": "1073741824", 2019-12-22T22:31:26.331 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_min_ratio": "0.020000", 2019-12-22T22:31:26.331 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_reclaim_ratio": "0.200000", 2019-12-22T22:31:26.331 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_autotune": "true", 2019-12-22T22:31:26.331 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_autotune_interval": "5.000000", 2019-12-22T22:31:26.331 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_kv_ratio": "0.400000", 2019-12-22T22:31:26.331 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_ratio": "0.400000", 2019-12-22T22:31:26.331 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_size": "0", 2019-12-22T22:31:26.332 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_size_hdd": "1073741824", 2019-12-22T22:31:26.332 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_size_ssd": "3221225472", 2019-12-22T22:31:26.332 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_trim_interval": "0.050000", 2019-12-22T22:31:26.332 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_trim_max_skip_pinned": "64", 2019-12-22T22:31:26.332 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_type": "2q", 2019-12-22T22:31:26.332 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_clone_cow": "true", 2019-12-22T22:31:26.332 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_algorithm": "snappy", 2019-12-22T22:31:26.333 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_max_blob_size": "0", 2019-12-22T22:31:26.333 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_max_blob_size_hdd": "524288", 2019-12-22T22:31:26.333 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2019-12-22T22:31:26.333 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_min_blob_size": "0", 2019-12-22T22:31:26.333 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_min_blob_size_hdd": "131072", 2019-12-22T22:31:26.333 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_min_blob_size_ssd": "8192", 2019-12-22T22:31:26.333 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_mode": "none", 2019-12-22T22:31:26.333 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_required_ratio": "0.875000", 2019-12-22T22:31:26.334 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_csum_type": "crc32c", 2019-12-22T22:31:26.334 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_enforce_settings": "default", 2019-12-22T22:31:26.334 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_freelist": "false", 2019-12-22T22:31:26.334 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_fsck_abort": "false", 2019-12-22T22:31:26.334 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_inject_bug21040": "false", 2019-12-22T22:31:26.334 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2019-12-22T22:31:26.335 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_inject_read_err": "false", 2019-12-22T22:31:26.335 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_misc": "false", 2019-12-22T22:31:26.335 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_no_reuse_blocks": "false", 2019-12-22T22:31:26.336 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_omit_block_device_write": "false", 2019-12-22T22:31:26.336 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_omit_kv_commit": "false", 2019-12-22T22:31:26.336 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2019-12-22T22:31:26.336 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_prefill": "0.000000", 2019-12-22T22:31:26.336 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_prefragment_max": "1048576", 2019-12-22T22:31:26.336 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_random_read_err": "0.000000", 2019-12-22T22:31:26.337 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2019-12-22T22:31:26.337 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_small_allocations": "0", 2019-12-22T22:31:26.337 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2019-12-22T22:31:26.337 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_default_buffered_read": "true", 2019-12-22T22:31:26.337 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_default_buffered_write": "false", 2019-12-22T22:31:26.337 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_deferred_batch_ops": "0", 2019-12-22T22:31:26.337 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2019-12-22T22:31:26.338 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2019-12-22T22:31:26.338 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2019-12-22T22:31:26.338 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_max_size": "1200", 2019-12-22T22:31:26.338 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_min_size": "150", 2019-12-22T22:31:26.338 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_target_size": "500", 2019-12-22T22:31:26.338 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2019-12-22T22:31:26.338 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_freelist_blocks_per_key": "128", 2019-12-22T22:31:26.339 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2019-12-22T22:31:26.339 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2019-12-22T22:31:26.339 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mkfs": "true", 2019-12-22T22:31:26.339 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2019-12-22T22:31:26.339 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mount": "false", 2019-12-22T22:31:26.339 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mount_deep": "false", 2019-12-22T22:31:26.339 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_umount": "false", 2019-12-22T22:31:26.339 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_umount_deep": "false", 2019-12-22T22:31:26.340 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_quick_fix_on_mount": "true", 2019-12-22T22:31:26.340 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_quick_fix_threads": "2", 2019-12-22T22:31:26.340 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2019-12-22T22:31:26.340 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_gc_enable_blob_threshold": "0", 2019-12-22T22:31:26.340 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_gc_enable_total_threshold": "0", 2019-12-22T22:31:26.340 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_ignore_data_csum": "false", 2019-12-22T22:31:26.340 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_ioring": "false", 2019-12-22T22:31:26.341 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_kvbackend": "rocksdb", 2019-12-22T22:31:26.341 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_log_collection_list_age": "60.000000", 2019-12-22T22:31:26.341 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2019-12-22T22:31:26.341 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_log_op_age": "5.000000", 2019-12-22T22:31:26.341 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_alloc_size": "0", 2019-12-22T22:31:26.341 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_blob_size": "0", 2019-12-22T22:31:26.341 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_blob_size_hdd": "524288", 2019-12-22T22:31:26.342 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_blob_size_ssd": "65536", 2019-12-22T22:31:26.342 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_defer_interval": "3.000000", 2019-12-22T22:31:26.342 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_deferred_txc": "32", 2019-12-22T22:31:26.342 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_min_alloc_size": "0", 2019-12-22T22:31:26.342 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_min_alloc_size_hdd": "4096", 2019-12-22T22:31:26.342 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_min_alloc_size_ssd": "4096", 2019-12-22T22:31:26.342 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_nid_prealloc": "1024", 2019-12-22T22:31:26.343 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_prefer_deferred_size": "0", 2019-12-22T22:31:26.343 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_prefer_deferred_size_hdd": "32768", 2019-12-22T22:31:26.343 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2019-12-22T22:31:26.343 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_retry_disk_reads": "3", 2019-12-22T22:31:26.343 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_cf": "false", 2019-12-22T22:31:26.343 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_cfs": "M= P= L=", 2019-12-22T22:31:26.343 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2", 2019-12-22T22:31:26.344 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_coremask": "0x1", 2019-12-22T22:31:26.344 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_io_sleep": "5", 2019-12-22T22:31:26.344 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_max_io_completion": "0", 2019-12-22T22:31:26.344 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_mem": "512", 2019-12-22T22:31:26.344 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_sync_submit_transaction": "false", 2019-12-22T22:31:26.344 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_bytes": "67108864", 2019-12-22T22:31:26.344 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_cost_per_io": "0", 2019-12-22T22:31:26.345 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2019-12-22T22:31:26.345 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2019-12-22T22:31:26.345 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2019-12-22T22:31:26.345 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_trace_rate": "0.000000", 2019-12-22T22:31:26.345 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_tracing": "false", 2019-12-22T22:31:26.345 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_volume_selection_policy": "rocksdb_original", 2019-12-22T22:31:26.345 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_volume_selection_reserved": "0", 2019-12-22T22:31:26.346 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2019-12-22T22:31:26.346 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2019-12-22T22:31:26.346 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_legacy_statfs": "true", 2019-12-22T22:31:26.346 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2019-12-22T22:31:26.347 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm_path": "/usr/sbin/cephadm", 2019-12-22T22:31:26.347 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_cluster_require_signatures": "false", 2019-12-22T22:31:26.347 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_cluster_require_version": "1", 2019-12-22T22:31:26.347 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_require_signatures": "false", 2019-12-22T22:31:26.347 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_require_version": "1", 2019-12-22T22:31:26.347 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_service_require_signatures": "false", 2019-12-22T22:31:26.347 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_service_require_version": "1", 2019-12-22T22:31:26.348 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_sign_messages": "true", 2019-12-22T22:31:26.348 INFO:teuthology.orchestra.run.smithi071.stdout: "chdir": "", 2019-12-22T22:31:26.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client_acl_type": "", 2019-12-22T22:31:26.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client_cache_mid": "0.750000", 2019-12-22T22:31:26.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client_cache_size": "16384", 2019-12-22T22:31:26.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client_caps_release_delay": "5", 2019-12-22T22:31:26.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client_check_pool_perm": "true", 2019-12-22T22:31:26.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_force_sync_read": "false", 2019-12-22T22:31:26.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_getattr_caps": "false", 2019-12-22T22:31:26.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_inject_tick_delay": "0", 2019-12-22T22:31:26.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_die_on_failed_dentry_invalidate": "true", 2019-12-22T22:31:26.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_die_on_failed_remount": "false", 2019-12-22T22:31:26.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_dirsize_rbytes": "true", 2019-12-22T22:31:26.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_force_lazyio": "false", 2019-12-22T22:31:26.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_inject_fixed_oldest_tid": "false", 2019-12-22T22:31:26.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_inject_release_failure": "false", 2019-12-22T22:31:26.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_max_inline_size": "4096", 2019-12-22T22:31:26.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mds_namespace": "", 2019-12-22T22:31:26.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_metadata": "", 2019-12-22T22:31:26.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mount_gid": "-1", 2019-12-22T22:31:26.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mount_timeout": "300.000000", 2019-12-22T22:31:26.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mount_uid": "-1", 2019-12-22T22:31:26.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mountpoint": "/", 2019-12-22T22:31:26.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_notify_timeout": "10", 2019-12-22T22:31:26.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc": "true", 2019-12-22T22:31:26.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_max_dirty": "104857600", 2019-12-22T22:31:26.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_max_dirty_age": "5.000000", 2019-12-22T22:31:26.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_max_objects": "1000", 2019-12-22T22:31:26.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_size": "209715200", 2019-12-22T22:31:26.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_target_dirty": "8388608", 2019-12-22T22:31:26.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_permissions": "true", 2019-12-22T22:31:26.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_quota_df": "true", 2019-12-22T22:31:26.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_readahead_max_bytes": "0", 2019-12-22T22:31:26.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_readahead_max_periods": "4", 2019-12-22T22:31:26.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_readahead_min": "131072", 2019-12-22T22:31:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_reconnect_stale": "false", 2019-12-22T22:31:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_snapdir": ".snap", 2019-12-22T22:31:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_tick_interval": "1.000000", 2019-12-22T22:31:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_trace": "", 2019-12-22T22:31:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_try_dentry_invalidate": "false", 2019-12-22T22:31:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_use_faked_inos": "false", 2019-12-22T22:31:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_use_random_mds": "false", 2019-12-22T22:31:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_graylog": "false", 2019-12-22T22:31:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_graylog_host": "127.0.0.1", 2019-12-22T22:31:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_graylog_port": "12201", 2019-12-22T22:31:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_monitors": "default=true", 2019-12-22T22:31:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_syslog": "false", 2019-12-22T22:31:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2019-12-22T22:31:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_syslog_level": "info", 2019-12-22T22:31:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "-", 2019-12-22T22:31:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_network": "", 2019-12-22T22:31:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_network_interface": "", 2019-12-22T22:31:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "colors": "Terminal", 2019-12-22T22:31:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zlib_isal": "false", 2019-12-22T22:31:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zlib_level": "5", 2019-12-22T22:31:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image": "quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107", 2019-12-22T22:31:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "continuation_prompt": ">", 2019-12-22T22:31:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "crash_dir": "/var/lib/ceph/crash", 2019-12-22T22:31:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_osd_obc_lru_size": "10", 2019-12-22T22:31:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "", 2019-12-22T22:31:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location_hook": "", 2019-12-22T22:31:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location_hook_timeout": "10", 2019-12-22T22:31:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "daemonize": "false", 2019-12-22T22:31:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_allow_any_pool_priority": "false", 2019-12-22T22:31:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_asok": "1/5", 2019-12-22T22:31:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_asok_assert_abort": "false", 2019-12-22T22:31:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_asserts_on_shutdown": "true", 2019-12-22T22:31:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_auth": "1/5", 2019-12-22T22:31:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_bdev": "1/3", 2019-12-22T22:31:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_bluefs": "1/5", 2019-12-22T22:31:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_bluestore": "1/5", 2019-12-22T22:31:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_buffer": "0/1", 2019-12-22T22:31:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_civetweb": "1/10", 2019-12-22T22:31:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_client": "0/5", 2019-12-22T22:31:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_compressor": "1/5", 2019-12-22T22:31:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_context": "0/1", 2019-12-22T22:31:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_crush": "1/1", 2019-12-22T22:31:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_crypto": "1/5", 2019-12-22T22:31:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_deliberately_leak_memory": "false", 2019-12-22T22:31:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_disable_randomized_ping": "false", 2019-12-22T22:31:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_dpdk": "1/5", 2019-12-22T22:31:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_eventtrace": "1/5", 2019-12-22T22:31:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_filer": "0/1", 2019-12-22T22:31:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_filestore": "1/3", 2019-12-22T22:31:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_finisher": "1/1", 2019-12-22T22:31:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_fuse": "1/5", 2019-12-22T22:31:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_heartbeat_testing_span": "0", 2019-12-22T22:31:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_heartbeatmap": "1/5", 2019-12-22T22:31:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_immutable_obj_cache": "0/5", 2019-12-22T22:31:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_javaclient": "1/5", 2019-12-22T22:31:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_journal": "1/3", 2019-12-22T22:31:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_journaler": "0/5", 2019-12-22T22:31:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_kstore": "1/5", 2019-12-22T22:31:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_leveldb": "4/5", 2019-12-22T22:31:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_lockdep": "0/1", 2019-12-22T22:31:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds": "1/5", 2019-12-22T22:31:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_balancer": "1/5", 2019-12-22T22:31:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_locker": "1/5", 2019-12-22T22:31:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_log": "1/5", 2019-12-22T22:31:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_log_expire": "1/5", 2019-12-22T22:31:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_migrator": "1/5", 2019-12-22T22:31:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_memdb": "4/5", 2019-12-22T22:31:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mgr": "1/5", 2019-12-22T22:31:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mgrc": "1/5", 2019-12-22T22:31:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mon": "20/20", 2019-12-22T22:31:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_monc": "0/10", 2019-12-22T22:31:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_ms": "1/1", 2019-12-22T22:31:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_none": "0/5", 2019-12-22T22:31:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_objclass": "0/5", 2019-12-22T22:31:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_objectcacher": "0/5", 2019-12-22T22:31:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_objecter": "0/1", 2019-12-22T22:31:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_optracker": "0/5", 2019-12-22T22:31:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_osd": "1/5", 2019-12-22T22:31:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_paxos": "20/20", 2019-12-22T22:31:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_perfcounter": "1/5", 2019-12-22T22:31:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_prioritycache": "1/5", 2019-12-22T22:31:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rados": "0/5", 2019-12-22T22:31:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd": "0/5", 2019-12-22T22:31:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd_mirror": "0/5", 2019-12-22T22:31:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd_replay": "0/5", 2019-12-22T22:31:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_refs": "0/0", 2019-12-22T22:31:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_reserver": "1/1", 2019-12-22T22:31:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw": "1/5", 2019-12-22T22:31:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_sync": "1/5", 2019-12-22T22:31:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rocksdb": "4/5", 2019-12-22T22:31:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_shell": "false", 2019-12-22T22:31:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_striper": "0/1", 2019-12-22T22:31:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_test": "0/5", 2019-12-22T22:31:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_throttle": "1/1", 2019-12-22T22:31:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_timer": "0/1", 2019-12-22T22:31:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_tp": "0/5", 2019-12-22T22:31:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "device_failure_prediction_mode": "none", 2019-12-22T22:31:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "echo": "false", 2019-12-22T22:31:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "editor": "vim", 2019-12-22T22:31:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2019-12-22T22:31:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2019-12-22T22:31:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_graylog": "false", 2019-12-22T22:31:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_stderr": "true", 2019-12-22T22:31:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_syslog": "false", 2019-12-22T22:31:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event_tracing": "false", 2019-12-22T22:31:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "fake_statfs_for_testing": "0", 2019-12-22T22:31:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "fatal_signal_handlers": "true", 2019-12-22T22:31:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "feedback_to_output": "false", 2019-12-22T22:31:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "filer_max_purge_ops": "10", 2019-12-22T22:31:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "filer_max_truncate_ops": "128", 2019-12-22T22:31:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_apply_finisher_threads": "1", 2019-12-22T22:31:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_blackhole": "false", 2019-12-22T22:31:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_btrfs_clone_range": "true", 2019-12-22T22:31:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_btrfs_snap": "true", 2019-12-22T22:31:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_caller_concurrency": "10", 2019-12-22T22:31:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_collect_device_partition_information": "true", 2019-12-22T22:31:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_commit_timeout": "600.000000", 2019-12-22T22:31:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_inject_read_err": "false", 2019-12-22T22:31:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_omap_check": "false", 2019-12-22T22:31:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_random_read_err": "0.000000", 2019-12-22T22:31:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_verify_split": "false", 2019-12-22T22:31:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_dump_file": "", 2019-12-22T22:31:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2019-12-22T22:31:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_expected_throughput_ops": "200.000000", 2019-12-22T22:31:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fadvise": "true", 2019-12-22T22:31:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fail_eio": "true", 2019-12-22T22:31:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fd_cache_shards": "16", 2019-12-22T22:31:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fd_cache_size": "128", 2019-12-22T22:31:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fiemap": "false", 2019-12-22T22:31:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fiemap_threshold": "4096", 2019-12-22T22:31:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fsync_flushes_journal_data": "false", 2019-12-22T22:31:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_index_retry_probability": "0.000000", 2019-12-22T22:31:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_inject_stall": "0", 2019-12-22T22:31:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_journal_parallel": "false", 2019-12-22T22:31:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_journal_trailing": "false", 2019-12-22T22:31:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_journal_writeahead": "false", 2019-12-22T22:31:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_kill_at": "0", 2019-12-22T22:31:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_alloc_hint_size": "1048576", 2019-12-22T22:31:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size": "0", 2019-12-22T22:31:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2019-12-22T22:31:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size_other": "512", 2019-12-22T22:31:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2019-12-22T22:31:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs": "0", 2019-12-22T22:31:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2019-12-22T22:31:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs_other": "2", 2019-12-22T22:31:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs_xfs": "10", 2019-12-22T22:31:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_sync_interval": "5.000000", 2019-12-22T22:31:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size": "0", 2019-12-22T22:31:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2019-12-22T22:31:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size_other": "1024", 2019-12-22T22:31:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2019-12-22T22:31:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_merge_threshold": "-10", 2019-12-22T22:31:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_min_sync_interval": "0.010000", 2019-12-22T22:31:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_odsync_write": "false", 2019-12-22T22:31:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_omap_backend": "rocksdb", 2019-12-22T22:31:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_omap_backend_path": "", 2019-12-22T22:31:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_omap_header_cache_size": "1024", 2019-12-22T22:31:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_ondisk_finisher_threads": "1", 2019-12-22T22:31:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_op_thread_suicide_timeout": "180", 2019-12-22T22:31:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_op_thread_timeout": "60", 2019-12-22T22:31:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_op_threads": "2", 2019-12-22T22:31:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_punch_hole": "false", 2019-12-22T22:31:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2019-12-22T22:31:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2019-12-22T22:31:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2019-12-22T22:31:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_threshhold": "0.900000", 2019-12-22T22:31:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_low_threshhold": "0.300000", 2019-12-22T22:31:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_bytes": "104857600", 2019-12-22T22:31:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2019-12-22T22:31:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2019-12-22T22:31:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2019-12-22T22:31:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_ops": "50", 2019-12-22T22:31:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2019-12-22T22:31:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_seek_data_hole": "false", 2019-12-22T22:31:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_sloppy_crc": "false", 2019-12-22T22:31:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_sloppy_crc_block_size": "65536", 2019-12-22T22:31:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_splice": "false", 2019-12-22T22:31:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_split_multiple": "2", 2019-12-22T22:31:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_split_rand_factor": "20", 2019-12-22T22:31:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_update_to": "1000", 2019-12-22T22:31:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2019-12-22T22:31:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2019-12-22T22:31:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2019-12-22T22:31:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2019-12-22T22:31:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2019-12-22T22:31:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2019-12-22T22:31:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_enable": "true", 2019-12-22T22:31:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2019-12-22T22:31:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2019-12-22T22:31:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2019-12-22T22:31:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2019-12-22T22:31:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2019-12-22T22:31:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2019-12-22T22:31:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_xfs_extsize": "false", 2019-12-22T22:31:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_zfs_snap": "false", 2019-12-22T22:31:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "fio_dir": "/tmp/fio", 2019-12-22T22:31:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "7a4dd340-2509-11ea-8284-001a4aab830c", 2019-12-22T22:31:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_allow_other": "true", 2019-12-22T22:31:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_atomic_o_trunc": "true", 2019-12-22T22:31:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_big_writes": "false", 2019-12-22T22:31:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_debug": "false", 2019-12-22T22:31:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_default_permissions": "false", 2019-12-22T22:31:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_disable_pagecache": "false", 2019-12-22T22:31:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_max_write": "0", 2019-12-22T22:31:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_multithreaded": "true", 2019-12-22T22:31:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_require_active_mds": "true", 2019-12-22T22:31:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_set_user_groups": "true", 2019-12-22T22:31:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_syncfs_on_mksnap": "true", 2019-12-22T22:31:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_use_invalidate_cb": "true", 2019-12-22T22:31:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2019-12-22T22:31:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "gss_target_name": "ceph", 2019-12-22T22:31:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_file": "", 2019-12-22T22:31:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_inject_failure": "0", 2019-12-22T22:31:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_interval": "5", 2019-12-22T22:31:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "host": "", 2019-12-22T22:31:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2019-12-22T22:31:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_max_inflight_ops": "128", 2019-12-22T22:31:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_max_size": "1073741824", 2019-12-22T22:31:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_path": "/tmp", 2019-12-22T22:31:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2019-12-22T22:31:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_watermark": "0.100000", 2019-12-22T22:31:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "inject_early_sigterm": "false", 2019-12-22T22:31:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_aio": "true", 2019-12-22T22:31:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_align_min_size": "65536", 2019-12-22T22:31:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_block_align": "true", 2019-12-22T22:31:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_block_size": "4096", 2019-12-22T22:31:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_dio": "true", 2019-12-22T22:31:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_discard": "false", 2019-12-22T22:31:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_force_aio": "false", 2019-12-22T22:31:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_ignore_corruption": "false", 2019-12-22T22:31:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_max_write_bytes": "10485760", 2019-12-22T22:31:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_max_write_entries": "100", 2019-12-22T22:31:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_replay_from": "0", 2019-12-22T22:31:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_high_multiple": "0.000000", 2019-12-22T22:31:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_high_threshhold": "0.900000", 2019-12-22T22:31:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_low_threshhold": "0.600000", 2019-12-22T22:31:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_max_multiple": "0.000000", 2019-12-22T22:31:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_write_header_frequency": "0", 2019-12-22T22:31:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_zero_on_create": "false", 2019-12-22T22:31:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "journaler_prefetch_periods": "10", 2019-12-22T22:31:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "journaler_prezero_periods": "5", 2019-12-22T22:31:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "journaler_write_head_interval": "15", 2019-12-22T22:31:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "", 2019-12-22T22:31:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "keyfile": "", 2019-12-22T22:31:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2019-12-22T22:31:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_backend": "rocksdb", 2019-12-22T22:31:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_default_stripe_size": "65536", 2019-12-22T22:31:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_fsck_on_mount": "false", 2019-12-22T22:31:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_fsck_on_mount_deep": "true", 2019-12-22T22:31:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_max_bytes": "67108864", 2019-12-22T22:31:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_max_ops": "512", 2019-12-22T22:31:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_nid_prealloc": "1024", 2019-12-22T22:31:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_onode_map_size": "1024", 2019-12-22T22:31:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2019-12-22T22:31:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_sync_submit_transaction": "false", 2019-12-22T22:31:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_sync_transaction": "false", 2019-12-22T22:31:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_block_size": "65536", 2019-12-22T22:31:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_bloom_size": "0", 2019-12-22T22:31:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_cache_size": "536870912", 2019-12-22T22:31:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_compact_on_mount": "false", 2019-12-22T22:31:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_compression": "false", 2019-12-22T22:31:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_log": "", 2019-12-22T22:31:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_log_to_ceph_log": "true", 2019-12-22T22:31:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_max_open_files": "0", 2019-12-22T22:31:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_paranoid": "false", 2019-12-22T22:31:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "leveldb_write_buffer_size": "33554432", 2019-12-22T22:31:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "lockdep": "false", 2019-12-22T22:31:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "lockdep_force_backtrace": "false", 2019-12-22T22:31:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "log_coarse_timestamps": "true", 2019-12-22T22:31:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2019-12-22T22:31:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "log_flush_on_exit": "false", 2019-12-22T22:31:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "log_graylog_host": "127.0.0.1", 2019-12-22T22:31:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "log_graylog_port": "12201", 2019-12-22T22:31:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "log_max_new": "1000", 2019-12-22T22:31:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "log_max_recent": "10000", 2019-12-22T22:31:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "log_stderr_prefix": "", 2019-12-22T22:31:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "log_stop_at_utilization": "0.970000", 2019-12-22T22:31:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": "true", 2019-12-22T22:31:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_graylog": "false", 2019-12-22T22:31:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_stderr": "false", 2019-12-22T22:31:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_syslog": "false", 2019-12-22T22:31:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "max_completion_items": "50", 2019-12-22T22:31:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "max_rotating_auth_attempts": "10", 2019-12-22T22:31:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_action_on_write_error": "1", 2019-12-22T22:31:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_export_pin": "true", 2019-12-22T22:31:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_dirs": "true", 2019-12-22T22:31:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2019-12-22T22:31:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_interval": "5", 2019-12-22T22:31:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_size_max": "100000", 2019-12-22T22:31:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_idle_threshold": "0.000000", 2019-12-22T22:31:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_interval": "10", 2019-12-22T22:31:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_max": "-1", 2019-12-22T22:31:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_max_until": "-1", 2019-12-22T22:31:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_merge_size": "50", 2019-12-22T22:31:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_midchunk": "0.300000", 2019-12-22T22:31:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_min_rebalance": "0.100000", 2019-12-22T22:31:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_min_start": "0.200000", 2019-12-22T22:31:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_minchunk": "0.001000", 2019-12-22T22:31:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_mode": "0", 2019-12-22T22:31:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_need_max": "1.200000", 2019-12-22T22:31:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_need_min": "0.800000", 2019-12-22T22:31:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_replicate_threshold": "8000.000000", 2019-12-22T22:31:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_sample_interval": "3.000000", 2019-12-22T22:31:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_bits": "3", 2019-12-22T22:31:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_rd": "25000.000000", 2019-12-22T22:31:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_size": "10000", 2019-12-22T22:31:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_wr": "10000.000000", 2019-12-22T22:31:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_target_decay": "10.000000", 2019-12-22T22:31:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2019-12-22T22:31:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_beacon_grace": "15.000000", 2019-12-22T22:31:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_beacon_interval": "4.000000", 2019-12-22T22:31:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_memory_limit": "4294967296", 2019-12-22T22:31:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_mid": "0.700000", 2019-12-22T22:31:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_release_free_interval": "10", 2019-12-22T22:31:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_reservation": "0.050000", 2019-12-22T22:31:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_trim_decay_rate": "1.000000", 2019-12-22T22:31:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_trim_interval": "1", 2019-12-22T22:31:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_trim_threshold": "65536", 2019-12-22T22:31:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2019-12-22T22:31:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_client_prealloc_inos": "1000", 2019-12-22T22:31:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2019-12-22T22:31:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_damage_table_max_entries": "10000", 2019-12-22T22:31:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2019-12-22T22:31:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_auth_pins": "false", 2019-12-22T22:31:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_frag": "false", 2019-12-22T22:31:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_scatterstat": "false", 2019-12-22T22:31:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_subtrees": "false", 2019-12-22T22:31:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_decay_halflife": "5.000000", 2019-12-22T22:31:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_default_dir_hash": "2", 2019-12-22T22:31:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_defer_session_stale": "true", 2019-12-22T22:31:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_keys_per_op": "16384", 2019-12-22T22:31:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_max_commit_size": "10", 2019-12-22T22:31:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dirstat_min_interval": "1.000000", 2019-12-22T22:31:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_after_rejoin": "false", 2019-12-22T22:31:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_on_map": "false", 2019-12-22T22:31:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_threshold_file": "0", 2019-12-22T22:31:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2019-12-22T22:31:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_early_reply": "true", 2019-12-22T22:31:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_enable_op_tracker": "true", 2019-12-22T22:31:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_enforce_unique_name": "true", 2019-12-22T22:31:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_freeze_tree_timeout": "30.000000", 2019-12-22T22:31:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2019-12-22T22:31:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_health_cache_threshold": "1.500000", 2019-12-22T22:31:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_health_summarize_threshold": "10", 2019-12-22T22:31:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_heartbeat_grace": "15.000000", 2019-12-22T22:31:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_migrator_session_race": "false", 2019-12-22T22:31:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2019-12-22T22:31:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_journal_format": "1", 2019-12-22T22:31:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_create_at": "0", 2019-12-22T22:31:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_export_at": "0", 2019-12-22T22:31:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_import_at": "0", 2019-12-22T22:31:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_journal_at": "0", 2019-12-22T22:31:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_journal_expire_at": "0", 2019-12-22T22:31:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_journal_replay_at": "0", 2019-12-22T22:31:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_link_at": "0", 2019-12-22T22:31:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_mdstable_at": "0", 2019-12-22T22:31:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_openc_at": "0", 2019-12-22T22:31:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_rename_at": "0", 2019-12-22T22:31:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_events_per_segment": "1024", 2019-12-22T22:31:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_max_events": "-1", 2019-12-22T22:31:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_max_segments": "128", 2019-12-22T22:31:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_pause": "false", 2019-12-22T22:31:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_segment_size": "0", 2019-12-22T22:31:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_skip_corrupt_events": "false", 2019-12-22T22:31:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_caps_per_client": "1048576", 2019-12-22T22:31:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_completed_flushes": "100000", 2019-12-22T22:31:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_completed_requests": "100000", 2019-12-22T22:31:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_export_size": "20971520", 2019-12-22T22:31:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_file_recover": "32", 2019-12-22T22:31:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_purge_files": "64", 2019-12-22T22:31:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_purge_ops": "8192", 2019-12-22T22:31:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2019-12-22T22:31:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_retries_on_remount_failure": "5", 2019-12-22T22:31:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_scrub_ops_in_progress": "5", 2019-12-22T22:31:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_snaps_per_dir": "100", 2019-12-22T22:31:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_xattr_pairs_size": "65536", 2019-12-22T22:31:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_min_caps_per_client": "100", 2019-12-22T22:31:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mon_shutdown_timeout": "5.000000", 2019-12-22T22:31:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_numa_node": "-1", 2019-12-22T22:31:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_complaint_time": "30.000000", 2019-12-22T22:31:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_duration": "600", 2019-12-22T22:31:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_size": "20", 2019-12-22T22:31:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_log_threshold": "5", 2019-12-22T22:31:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2019-12-22T22:31:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_global_max_decay_threshold": "65536", 2019-12-22T22:31:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_max_caps": "5000", 2019-12-22T22:31:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_max_decay_rate": "2.500000", 2019-12-22T22:31:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_max_decay_threshold": "16384", 2019-12-22T22:31:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_warning_decay_rate": "60.000000", 2019-12-22T22:31:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_warning_threshold": "32768", 2019-12-22T22:31:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_reconnect_timeout": "45.000000", 2019-12-22T22:31:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_replay_interval": "1.000000", 2019-12-22T22:31:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_replay_unsafe_with_closed_session": "false", 2019-12-22T22:31:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_request_load_average_decay_rate": "60.000000", 2019-12-22T22:31:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_root_ino_gid": "0", 2019-12-22T22:31:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_root_ino_uid": "0", 2019-12-22T22:31:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_scatter_nudge_interval": "5.000000", 2019-12-22T22:31:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_blacklist_on_evict": "true", 2019-12-22T22:31:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_blacklist_on_timeout": "true", 2019-12-22T22:31:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2019-12-22T22:31:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cache_liveness_magnitude": "10", 2019-12-22T22:31:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessionmap_keys_per_op": "1024", 2019-12-22T22:31:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_shutdown_check": "0", 2019-12-22T22:31:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_skip_ino": "0", 2019-12-22T22:31:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_snap_max_uid": "4294967294", 2019-12-22T22:31:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_snap_min_uid": "0", 2019-12-22T22:31:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_snap_rstat": "false", 2019-12-22T22:31:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_task_status_update_interval": "2.000000", 2019-12-22T22:31:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_thrash_exports": "0", 2019-12-22T22:31:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_thrash_fragments": "0", 2019-12-22T22:31:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_tick_interval": "5.000000", 2019-12-22T22:31:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_verify_backtrace": "1", 2019-12-22T22:31:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_verify_scatter": "false", 2019-12-22T22:31:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_wipe_ino_prealloc": "false", 2019-12-22T22:31:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_wipe_sessions": "false", 2019-12-22T22:31:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool_debug": "false", 2019-12-22T22:31:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_debug_omit_block_device_write": "false", 2019-12-22T22:31:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_device_bytes": "1073741824", 2019-12-22T22:31:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_page_set": "false", 2019-12-22T22:31:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_page_size": "65536", 2019-12-22T22:31:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_client_bytes": "134217728", 2019-12-22T22:31:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_client_messages": "512", 2019-12-22T22:31:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2019-12-22T22:31:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_connect_retry_interval": "1.000000", 2019-12-22T22:31:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2019-12-22T22:31:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2019-12-22T22:31:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_initial_modules": "restful iostat", 2019-12-22T22:31:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mds_bytes": "134217728", 2019-12-22T22:31:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mds_messages": "128", 2019-12-22T22:31:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2019-12-22T22:31:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mon_bytes": "134217728", 2019-12-22T22:31:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mon_messages": "128", 2019-12-22T22:31:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_osd_bytes": "536870912", 2019-12-22T22:31:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_osd_messages": "8192", 2019-12-22T22:31:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_service_beacon_grace": "60.000000", 2019-12-22T22:31:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_stats_period": "5", 2019-12-22T22:31:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_stats_threshold": "5", 2019-12-22T22:31:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_tick_period": "2", 2019-12-22T22:31:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_accept_timeout_factor": "2.000000", 2019-12-22T22:31:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_allow_pool_delete": "true", 2019-12-22T22:31:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2019-12-22T22:31:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2019-12-22T22:31:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_bytes": "104857600", 2019-12-22T22:31:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_directed_command_retry": "5", 2019-12-22T22:31:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval": "3.000000", 2019-12-22T22:31:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2019-12-22T22:31:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2019-12-22T22:31:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2019-12-22T22:31:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_parallel": "3", 2019-12-22T22:31:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_max_log_entries_per_message": "1000", 2019-12-22T22:31:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_ping_interval": "10.000000", 2019-12-22T22:31:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_ping_timeout": "30.000000", 2019-12-22T22:31:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_clock_drift_allowed": "1.000000", 2019-12-22T22:31:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2019-12-22T22:31:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2019-12-22T22:31:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_file_level": "debug", 2019-12-22T22:31:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_file": "true", 2019-12-22T22:31:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_graylog": "false", 2019-12-22T22:31:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2019-12-22T22:31:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_graylog_port": "12201", 2019-12-22T22:31:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_stderr": "false", 2019-12-22T22:31:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_syslog": "default=false", 2019-12-22T22:31:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2019-12-22T22:31:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_syslog_level": "info", 2019-12-22T22:31:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_compact_on_bootstrap": "false", 2019-12-22T22:31:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_compact_on_start": "false", 2019-12-22T22:31:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_compact_on_trim": "true", 2019-12-22T22:31:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_config_key_max_entry_size": "65536", 2019-12-22T22:31:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cpu_threads": "4", 2019-12-22T22:31:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_crush_min_required_version": "hammer", 2019-12-22T22:31:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_daemon_bytes": "419430400", 2019-12-22T22:31:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2019-12-22T22:31:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data_avail_crit": "5", 2019-12-22T22:31:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data_avail_warn": "5", 2019-12-22T22:31:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data_size_warn": "16106127360", 2019-12-22T22:31:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_block_osdmap_trim": "false", 2019-12-22T22:31:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_deprecated_as_obsolete": "false", 2019-12-22T22:31:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_dump_json": "false", 2019-12-22T22:31:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2019-12-22T22:31:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_dump_transactions": "false", 2019-12-22T22:31:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_extra_checks": "false", 2019-12-22T22:31:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_initial_persistent_features": "false", 2019-12-22T22:31:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2019-12-22T22:31:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_require_nautilus": "false", 2019-12-22T22:31:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_require_octopus": "false", 2019-12-22T22:31:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2019-12-22T22:31:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_delta_reset_interval": "10.000000", 2019-12-22T22:31:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_dns_srv_name": "ceph-mon", 2019-12-22T22:31:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_election_timeout": "5.000000", 2019-12-22T22:31:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_enable_op_tracker": "true", 2019-12-22T22:31:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_fake_pool_delete": "false", 2019-12-22T22:31:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_force_quorum_join": "false", 2019-12-22T22:31:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_globalid_prealloc": "10000", 2019-12-22T22:31:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_log_update_period": "5", 2019-12-22T22:31:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_max_detail": "50", 2019-12-22T22:31:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_to_clog": "true", 2019-12-22T22:31:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_to_clog_interval": "3600", 2019-12-22T22:31:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2019-12-22T22:31:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_host": "172.21.15.71:6789/0", 2019-12-22T22:31:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_initial_members": "", 2019-12-22T22:31:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2019-12-22T22:31:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2019-12-22T22:31:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_transaction_delay_max": "10.000000", 2019-12-22T22:31:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2019-12-22T22:31:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_keyvaluedb": "rocksdb", 2019-12-22T22:31:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_lease": "5.000000", 2019-12-22T22:31:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2019-12-22T22:31:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_lease_renew_interval_factor": "0.600000", 2019-12-22T22:31:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_log_max_summary": "50", 2019-12-22T22:31:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_log_entries_per_event": "4096", 2019-12-22T22:31:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_log_epochs": "500", 2019-12-22T22:31:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_mdsmap_epochs": "500", 2019-12-22T22:31:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_mgrmap_epochs": "500", 2019-12-22T22:31:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_osd": "10000", 2019-12-22T22:31:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_pg_per_osd": "10000", 2019-12-22T22:31:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_pool_pg_num": "65536", 2019-12-22T22:31:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_snap_prune_per_epoch": "100", 2019-12-22T22:31:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mds_blacklist_interval": "86400.000000", 2019-12-22T22:31:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mds_force_trim_to": "0", 2019-12-22T22:31:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mds_skip_sanity": "false", 2019-12-22T22:31:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_memory_autotune": "true", 2019-12-22T22:31:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_memory_target": "2147483648", 2019-12-22T22:31:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_beacon_grace": "30", 2019-12-22T22:31:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_blacklist_interval": "86400.000000", 2019-12-22T22:31:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_digest_period": "5", 2019-12-22T22:31:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_inactive_grace": "60", 2019-12-22T22:31:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_mkfs_grace": "240", 2019-12-22T22:31:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2019-12-22T22:31:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_min_osdmap_epochs": "50", 2019-12-22T22:31:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_complaint_time": "30", 2019-12-22T22:31:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_duration": "600", 2019-12-22T22:31:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_size": "20", 2019-12-22T22:31:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_slow_op_size": "20", 2019-12-22T22:31:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_slow_op_threshold": "10", 2019-12-22T22:31:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_log_threshold": "5", 2019-12-22T22:31:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_adjust_down_out_interval": "true", 2019-12-22T22:31:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2019-12-22T22:31:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2019-12-22T22:31:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_auto_mark_in": "false", 2019-12-22T22:31:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_auto_mark_new_in": "true", 2019-12-22T22:31:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2019-12-22T22:31:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_blacklist_default_expire": "3600.000000", 2019-12-22T22:31:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_cache_size": "500", 2019-12-22T22:31:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_cache_size_min": "134217728", 2019-12-22T22:31:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_crush_smoke_test": "true", 2019-12-22T22:31:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_destroyed_out_interval": "600", 2019-12-22T22:31:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_down_out_interval": "600", 2019-12-22T22:31:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_down_out_subtree_limit": "rack", 2019-12-22T22:31:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2019-12-22T22:31:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_force_trim_to": "0", 2019-12-22T22:31:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_full_ratio": "0.950000", 2019-12-22T22:31:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_initial_require_min_compat_client": "jewel", 2019-12-22T22:31:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_laggy_halflife": "3600", 2019-12-22T22:31:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_laggy_max_interval": "300", 2019-12-22T22:31:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_laggy_weight": "0.300000", 2019-12-22T22:31:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2019-12-22T22:31:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_max_creating_pgs": "1024", 2019-12-22T22:31:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_max_initial_pgs": "1024", 2019-12-22T22:31:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_min_down_reporters": "2", 2019-12-22T22:31:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_min_in_ratio": "0.750000", 2019-12-22T22:31:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_min_up_ratio": "0.300000", 2019-12-22T22:31:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_nearfull_ratio": "0.850000", 2019-12-22T22:31:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_prime_pg_temp": "true", 2019-12-22T22:31:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2019-12-22T22:31:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2019-12-22T22:31:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_report_timeout": "900", 2019-12-22T22:31:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_reporter_subtree_level": "osd", 2019-12-22T22:31:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2019-12-22T22:31:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_warn_op_age": "32.000000", 2019-12-22T22:31:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_enabled": "true", 2019-12-22T22:31:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_interval": "2", 2019-12-22T22:31:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_min": "15", 2019-12-22T22:31:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_txsize": "2", 2019-12-22T22:31:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2019-12-22T22:31:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_stuck_threshold": "60", 2019-12-22T22:31:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2019-12-22T22:31:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_min_objects": "10000", 2019-12-22T22:31:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_min_per_osd": "0", 2019-12-22T22:31:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_min_pool_objects": "1000", 2019-12-22T22:31:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pool_quota_crit_threshold": "0", 2019-12-22T22:31:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pool_quota_warn_threshold": "0", 2019-12-22T22:31:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_probe_timeout": "2.000000", 2019-12-22T22:31:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_max_change": "0.050000", 2019-12-22T22:31:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_max_osds": "4", 2019-12-22T22:31:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_min_bytes_per_osd": "10", 2019-12-22T22:31:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_min_pgs_per_osd": "4", 2019-12-22T22:31:26.442 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2019-12-22T22:31:26.442 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2019-12-22T22:31:26.442 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2019-12-22T22:31:26.442 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_interval": "86400", 2019-12-22T22:31:26.442 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_max_keys": "100", 2019-12-22T22:31:26.442 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_timeout": "300", 2019-12-22T22:31:26.442 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_session_timeout": "300", 2019-12-22T22:31:26.443 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_smart_report_timeout": "5", 2019-12-22T22:31:26.443 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stat_smooth_intervals": "6", 2019-12-22T22:31:26.443 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_subscribe_interval": "86400.000000", 2019-12-22T22:31:26.443 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_debug": "false", 2019-12-22T22:31:26.443 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_max_payload_keys": "2000", 2019-12-22T22:31:26.443 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_max_payload_size": "1048576", 2019-12-22T22:31:26.443 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_provider_kill_at": "0", 2019-12-22T22:31:26.444 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_requester_kill_at": "0", 2019-12-22T22:31:26.444 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_timeout": "60.000000", 2019-12-22T22:31:26.444 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_target_pg_per_osd": "100", 2019-12-22T22:31:26.444 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_tick_interval": "5", 2019-12-22T22:31:26.444 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_timecheck_interval": "300.000000", 2019-12-22T22:31:26.444 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_timecheck_skew_interval": "30.000000", 2019-12-22T22:31:26.444 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2019-12-22T22:31:26.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2019-12-22T22:31:26.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2019-12-22T22:31:26.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_misplaced": "false", 2019-12-22T22:31:26.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2019-12-22T22:31:26.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2019-12-22T22:31:26.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_pool_no_app": "true", 2019-12-22T22:31:26.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_pool_no_redundancy": "true", 2019-12-22T22:31:26.446 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2019-12-22T22:31:26.446 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2019-12-22T22:31:26.446 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2019-12-22T22:31:26.446 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_too_few_osds": "false", 2019-12-22T22:31:26.446 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2019-12-22T22:31:26.446 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2019-12-22T22:31:26.446 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": "", 2019-12-22T22:31:26.447 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_max_op_threads": "5", 2019-12-22T22:31:26.447 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_op_threads": "3", 2019-12-22T22:31:26.447 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_buffer_size": "131072", 2019-12-22T22:31:26.447 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_cm": "false", 2019-12-22T22:31:26.447 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_device_name": "", 2019-12-22T22:31:26.447 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_dscp": "96", 2019-12-22T22:31:26.447 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_enable_hugepage": "false", 2019-12-22T22:31:26.448 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_gid_idx": "0", 2019-12-22T22:31:26.448 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_local_gid": "", 2019-12-22T22:31:26.448 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_polling_us": "1000", 2019-12-22T22:31:26.448 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_port_num": "1", 2019-12-22T22:31:26.448 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_receive_buffers": "32768", 2019-12-22T22:31:26.448 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_receive_queue_len": "4096", 2019-12-22T22:31:26.448 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_roce_ver": "1", 2019-12-22T22:31:26.449 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_send_buffers": "1024", 2019-12-22T22:31:26.449 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_sl": "3", 2019-12-22T22:31:26.449 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_support_srq": "true", 2019-12-22T22:31:26.449 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_type": "ib", 2019-12-22T22:31:26.449 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_before_connect": "false", 2019-12-22T22:31:26.449 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_ipv4": "true", 2019-12-22T22:31:26.449 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_ipv6": "false", 2019-12-22T22:31:26.450 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_msgr1": "true", 2019-12-22T22:31:26.450 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_msgr2": "false", 2019-12-22T22:31:26.450 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_port_max": "7300", 2019-12-22T22:31:26.450 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_port_min": "6800", 2019-12-22T22:31:26.450 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_prefer_ipv4": "false", 2019-12-22T22:31:26.451 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_retry_count": "3", 2019-12-22T22:31:26.451 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_retry_delay": "5", 2019-12-22T22:31:26.451 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_client": "false", 2019-12-22T22:31:26.451 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_mds": "false", 2019-12-22T22:31:26.451 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_mgr": "false", 2019-12-22T22:31:26.451 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_mon": "false", 2019-12-22T22:31:26.451 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_osd": "false", 2019-12-22T22:31:26.452 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_client_mode": "crc secure", 2019-12-22T22:31:26.452 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_cluster_mode": "crc secure", 2019-12-22T22:31:26.452 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_cluster_type": "", 2019-12-22T22:31:26.452 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_connection_idle_timeout": "900", 2019-12-22T22:31:26.452 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_connection_ready_timeout": "10", 2019-12-22T22:31:26.452 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_crc_data": "true", 2019-12-22T22:31:26.452 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_crc_header": "true", 2019-12-22T22:31:26.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_bad_msg": "false", 2019-12-22T22:31:26.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_bug": "true", 2019-12-22T22:31:26.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_old_message": "true", 2019-12-22T22:31:26.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_skipped_message": "false", 2019-12-22T22:31:26.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_unhandled_msg": "false", 2019-12-22T22:31:26.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dispatch_throttle_bytes": "104857600", 2019-12-22T22:31:26.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_coremask": "0xF", 2019-12-22T22:31:26.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_debug_allow_loopback": "false", 2019-12-22T22:31:26.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2019-12-22T22:31:26.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_host_ipv4_addr": "", 2019-12-22T22:31:26.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_hugepages": "", 2019-12-22T22:31:26.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_hw_flow_control": "true", 2019-12-22T22:31:26.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2019-12-22T22:31:26.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_lro": "true", 2019-12-22T22:31:26.455 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_memory_channel": "4", 2019-12-22T22:31:26.455 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2019-12-22T22:31:26.455 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_pmd": "", 2019-12-22T22:31:26.455 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_port_id": "0", 2019-12-22T22:31:26.455 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2019-12-22T22:31:26.455 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dump_corrupt_message_level": "1", 2019-12-22T22:31:26.455 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dump_on_send": "false", 2019-12-22T22:31:26.456 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_initial_backoff": "0.200000", 2019-12-22T22:31:26.456 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_max": "1.000000", 2019-12-22T22:31:26.456 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_msg_type": "", 2019-12-22T22:31:26.456 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_probability": "0.005000", 2019-12-22T22:31:26.456 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_type": "osd", 2019-12-22T22:31:26.456 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_internal_delays": "0.002000", 2019-12-22T22:31:26.456 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_socket_failures": "2500", 2019-12-22T22:31:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_learn_addr_from_peer": "true", 2019-12-22T22:31:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_max_accept_failures": "4", 2019-12-22T22:31:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_max_backoff": "15.000000", 2019-12-22T22:31:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_mon_client_mode": "secure crc", 2019-12-22T22:31:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_mon_cluster_mode": "secure crc", 2019-12-22T22:31:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_mon_service_mode": "secure crc", 2019-12-22T22:31:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2019-12-22T22:31:26.458 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_pq_min_cost": "65536", 2019-12-22T22:31:26.458 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_public_type": "", 2019-12-22T22:31:26.458 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_service_mode": "crc secure", 2019-12-22T22:31:26.458 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_listen_backlog": "512", 2019-12-22T22:31:26.458 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_nodelay": "true", 2019-12-22T22:31:26.458 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_prefetch_max_size": "4096", 2019-12-22T22:31:26.458 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_rcvbuf": "0", 2019-12-22T22:31:26.458 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_type": "async+posix", 2019-12-22T22:31:26.459 INFO:teuthology.orchestra.run.smithi071.stdout: "no_config_file": "false", 2019-12-22T22:31:26.459 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_completion_locks_per_session": "32", 2019-12-22T22:31:26.459 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_debug_inject_relock_delay": "false", 2019-12-22T22:31:26.459 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_inflight_op_bytes": "104857600", 2019-12-22T22:31:26.459 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_inflight_ops": "1024", 2019-12-22T22:31:26.459 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_inject_no_watch_ping": "false", 2019-12-22T22:31:26.459 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_retry_writes_after_first_reply": "false", 2019-12-22T22:31:26.460 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_tick_interval": "5.000000", 2019-12-22T22:31:26.460 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_timeout": "10.000000", 2019-12-22T22:31:26.460 INFO:teuthology.orchestra.run.smithi071.stdout: "objectstore_blackhole": "false", 2019-12-22T22:31:26.460 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_delay_time": "5.000000", 2019-12-22T22:31:26.460 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_hist_halflife": "1000", 2019-12-22T22:31:26.460 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_max_low_ops": "2", 2019-12-22T22:31:26.460 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_max_ops": "4", 2019-12-22T22:31:26.461 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_min_evict_effort": "0.100000", 2019-12-22T22:31:26.461 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_quantize_effort": "0.100000", 2019-12-22T22:31:26.461 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_slop": "0.020000", 2019-12-22T22:31:26.461 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_allow_recovery_below_min_size": "true", 2019-12-22T22:31:26.462 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_async_recovery_min_cost": "100", 2019-12-22T22:31:26.462 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_auto_mark_unfound_lost": "false", 2019-12-22T22:31:26.462 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backfill_retry_interval": "30.000000", 2019-12-22T22:31:26.462 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backfill_scan_max": "512", 2019-12-22T22:31:26.462 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backfill_scan_min": "64", 2019-12-22T22:31:26.462 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backoff_on_degraded": "false", 2019-12-22T22:31:26.462 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backoff_on_peering": "false", 2019-12-22T22:31:26.463 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backoff_on_unfound": "true", 2019-12-22T22:31:26.463 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_beacon_report_interval": "300", 2019-12-22T22:31:26.463 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_duration": "30", 2019-12-22T22:31:26.463 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_large_size_max_throughput": "104857600", 2019-12-22T22:31:26.463 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_max_block_size": "67108864", 2019-12-22T22:31:26.463 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_small_size_max_iops": "100", 2019-12-22T22:31:26.463 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_blkin_trace_all": "false", 2019-12-22T22:31:26.464 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2019-12-22T22:31:26.464 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2019-12-22T22:31:26.464 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_check_for_log_corruption": "false", 2019-12-22T22:31:26.464 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_check_max_object_name_len_on_startup": "true", 2019-12-22T22:31:26.464 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", 2019-12-22T22:31:26.464 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2019-12-22T22:31:26.464 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", 2019-12-22T22:31:26.465 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_update_on_start": "true", 2019-12-22T22:31:26.465 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_message_cap": "100", 2019-12-22T22:31:26.465 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_message_size_cap": "524288000", 2019-12-22T22:31:26.465 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_op_priority": "63", 2019-12-22T22:31:26.465 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_watch_timeout": "30", 2019-12-22T22:31:26.465 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_command_max_records": "256", 2019-12-22T22:31:26.465 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_command_thread_suicide_timeout": "900", 2019-12-22T22:31:26.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_command_thread_timeout": "600", 2019-12-22T22:31:26.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_copyfrom_max_chunk": "8388608", 2019-12-22T22:31:26.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_chooseleaf_type": "1", 2019-12-22T22:31:26.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_initial_weight": "-1.000000", 2019-12-22T22:31:26.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_update_on_start": "true", 2019-12-22T22:31:26.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_update_weight_set": "true", 2019-12-22T22:31:26.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2019-12-22T22:31:26.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2019-12-22T22:31:26.467 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2019-12-22T22:31:26.467 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_drop_ping_duration": "0", 2019-12-22T22:31:26.467 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_drop_ping_probability": "0.000000", 2019-12-22T22:31:26.467 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_feed_pullee": "-1", 2019-12-22T22:31:26.467 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_inject_copyfrom_error": "false", 2019-12-22T22:31:26.467 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2019-12-22T22:31:26.467 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2019-12-22T22:31:26.468 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_misdirected_ops": "false", 2019-12-22T22:31:26.468 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_no_acting_change": "false", 2019-12-22T22:31:26.468 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_no_purge_strays": "false", 2019-12-22T22:31:26.468 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_op_order": "false", 2019-12-22T22:31:26.468 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_pg_log_writeout": "false", 2019-12-22T22:31:26.468 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_pretend_recovery_active": "false", 2019-12-22T22:31:26.468 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_random_push_read_error": "0.000000", 2019-12-22T22:31:26.469 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2019-12-22T22:31:26.469 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_shutdown": "false", 2019-12-22T22:31:26.469 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2019-12-22T22:31:26.469 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2019-12-22T22:31:26.469 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_cached_snaps": "false", 2019-12-22T22:31:26.469 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_missing_on_start": "false", 2019-12-22T22:31:26.469 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_snaps": "false", 2019-12-22T22:31:26.470 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_stray_on_activate": "false", 2019-12-22T22:31:26.470 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_interval": "604800.000000", 2019-12-22T22:31:26.470 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_keys": "1024", 2019-12-22T22:31:26.470 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2019-12-22T22:31:26.470 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2019-12-22T22:31:26.470 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2019-12-22T22:31:26.470 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_stride": "524288", 2019-12-22T22:31:26.471 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2019-12-22T22:31:26.471 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_default_data_pool_replay_window": "45", 2019-12-22T22:31:26.471 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_default_notify_timeout": "30", 2019-12-22T22:31:26.471 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep": "0.000000", 2019-12-22T22:31:26.472 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep_hdd": "5.000000", 2019-12-22T22:31:26.472 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep_hybrid": "2.000000", 2019-12-22T22:31:26.472 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep_ssd": "0.000000", 2019-12-22T22:31:26.472 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_discard_disconnected_ops": "true", 2019-12-22T22:31:26.472 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_enable_op_tracker": "true", 2019-12-22T22:31:26.472 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_erasure_code_plugins": "jerasure lrc isa", 2019-12-22T22:31:26.472 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_failsafe_full_ratio": "0.970000", 2019-12-22T22:31:26.473 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_fail_on_connection_refused": "true", 2019-12-22T22:31:26.473 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_info": "true", 2019-12-22T22:31:26.473 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_shutdown": "true", 2019-12-22T22:31:26.473 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_find_best_info_ignore_history_les": "false", 2019-12-22T22:31:26.473 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_force_auth_primary_missing_objects": "100", 2019-12-22T22:31:26.473 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2019-12-22T22:31:26.473 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_function_tracing": "false", 2019-12-22T22:31:26.474 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_grace": "20", 2019-12-22T22:31:26.474 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_interval": "6", 2019-12-22T22:31:26.474 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2019-12-22T22:31:26.474 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_min_peers": "10", 2019-12-22T22:31:26.474 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_min_size": "2000", 2019-12-22T22:31:26.474 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_stale": "600", 2019-12-22T22:31:26.474 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2019-12-22T22:31:26.475 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_hit_set_max_size": "100000", 2019-12-22T22:31:26.475 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_hit_set_min_size": "1000", 2019-12-22T22:31:26.475 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_hit_set_namespace": ".ceph-internal", 2019-12-22T22:31:26.475 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_ignore_stale_divergent_priors": "false", 2019-12-22T22:31:26.475 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2019-12-22T22:31:26.475 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_inject_failure_on_pg_removal": "false", 2019-12-22T22:31:26.475 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2019-12-22T22:31:26.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_journal_flush_on_shutdown": "true", 2019-12-22T22:31:26.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_journal_size": "5120", 2019-12-22T22:31:26.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_kill_backfill_at": "0", 2019-12-22T22:31:26.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_loop_before_reset_tphandle": "64", 2019-12-22T22:31:26.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_cache_size": "50", 2019-12-22T22:31:26.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_dedup": "true", 2019-12-22T22:31:26.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_message_max": "40", 2019-12-22T22:31:26.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_message_max_bytes": "10485760", 2019-12-22T22:31:26.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_share_max_epochs": "40", 2019-12-22T22:31:26.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_attr_name_len": "100", 2019-12-22T22:31:26.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_attr_size": "0", 2019-12-22T22:31:26.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_backfills": "1", 2019-12-22T22:31:26.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_markdown_count": "5", 2019-12-22T22:31:26.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_markdown_period": "600", 2019-12-22T22:31:26.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_object_name_len": "2048", 2019-12-22T22:31:26.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_object_namespace_len": "256", 2019-12-22T22:31:26.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_object_size": "134217728", 2019-12-22T22:31:26.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2019-12-22T22:31:26.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_omap_entries_per_request": "1024", 2019-12-22T22:31:26.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pg_blocked_by": "16", 2019-12-22T22:31:26.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pg_log_entries": "3000", 2019-12-22T22:31:26.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2019-12-22T22:31:26.479 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pgls": "1024", 2019-12-22T22:31:26.479 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_push_cost": "8388608", 2019-12-22T22:31:26.479 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_push_objects": "10", 2019-12-22T22:31:26.479 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_scrubs": "1", 2019-12-22T22:31:26.479 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2019-12-22T22:31:26.479 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_trimming_pgs": "2", 2019-12-22T22:31:26.479 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_write_op_reply_len": "32", 2019-12-22T22:31:26.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_write_size": "90", 2019-12-22T22:31:26.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2019-12-22T22:31:26.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2019-12-22T22:31:26.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2019-12-22T22:31:26.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2019-12-22T22:31:26.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2019-12-22T22:31:26.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2019-12-22T22:31:26.481 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2019-12-22T22:31:26.481 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_client_lim": "999999", 2019-12-22T22:31:26.481 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_client_res": "1", 2019-12-22T22:31:26.481 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_client_wgt": "1", 2019-12-22T22:31:26.481 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_base": "805306368", 2019-12-22T22:31:26.482 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_cache_min": "134217728", 2019-12-22T22:31:26.482 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_cache_resize_interval": "1.000000", 2019-12-22T22:31:26.482 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_expected_fragmentation": "0.150000", 2019-12-22T22:31:26.482 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_target": "4294967296", 2019-12-22T22:31:26.482 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2019-12-22T22:31:26.482 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_min_pg_log_entries": "3000", 2019-12-22T22:31:26.482 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_min_recovery_priority": "0", 2019-12-22T22:31:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_ack_timeout": "30.000000", 2019-12-22T22:31:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_heartbeat_interval": "30", 2019-12-22T22:31:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2019-12-22T22:31:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_report_interval": "5", 2019-12-22T22:31:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_report_max_in_flight": "2", 2019-12-22T22:31:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_shutdown_timeout": "5.000000", 2019-12-22T22:31:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_num_cache_shards": "32", 2019-12-22T22:31:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_num_op_tracker_shard": "32", 2019-12-22T22:31:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_numa_auto_affinity": "true", 2019-12-22T22:31:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_numa_node": "-1", 2019-12-22T22:31:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_numa_prefer_iface": "true", 2019-12-22T22:31:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_object_clean_region_max_num_intervals": "10", 2019-12-22T22:31:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objecter_finishers": "1", 2019-12-22T22:31:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore": "bluestore", 2019-12-22T22:31:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore_fuse": "false", 2019-12-22T22:31:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore_tracing": "false", 2019-12-22T22:31:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_complaint_time": "30.000000", 2019-12-22T22:31:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_duration": "600", 2019-12-22T22:31:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_size": "20", 2019-12-22T22:31:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_slow_op_size": "20", 2019-12-22T22:31:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2019-12-22T22:31:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_log_threshold": "5", 2019-12-22T22:31:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_shards": "0", 2019-12-22T22:31:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_shards_hdd": "5", 2019-12-22T22:31:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_shards_ssd": "8", 2019-12-22T22:31:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_threads_per_shard": "0", 2019-12-22T22:31:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2019-12-22T22:31:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2019-12-22T22:31:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2019-12-22T22:31:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_pq_min_cost": "65536", 2019-12-22T22:31:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_queue": "wpq", 2019-12-22T22:31:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_queue_cut_off": "high", 2019-12-22T22:31:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_thread_suicide_timeout": "150", 2019-12-22T22:31:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_thread_timeout": "15", 2019-12-22T22:31:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_open_classes_on_start": "true", 2019-12-22T22:31:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_os_flags": "0", 2019-12-22T22:31:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_peering_op_priority": "255", 2019-12-22T22:31:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_delete_cost": "1048576", 2019-12-22T22:31:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_delete_priority": "5", 2019-12-22T22:31:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2019-12-22T22:31:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2019-12-22T22:31:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_log_dups_tracked": "3000", 2019-12-22T22:31:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_log_trim_max": "10000", 2019-12-22T22:31:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_log_trim_min": "100", 2019-12-22T22:31:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2019-12-22T22:31:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_object_context_cache_count": "64", 2019-12-22T22:31:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_stat_report_interval_max": "500", 2019-12-22T22:31:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2019-12-22T22:31:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_min_evict_age": "0", 2019-12-22T22:31:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_min_flush_age": "0", 2019-12-22T22:31:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2019-12-22T22:31:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2019-12-22T22:31:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2019-12-22T22:31:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_crush_rule": "-1", 2019-12-22T22:31:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_ec_fast_read": "false", 2019-12-22T22:31:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd", 2019-12-22T22:31:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_hashpspool": "true", 2019-12-22T22:31:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_nodelete": "false", 2019-12-22T22:31:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_nopgchange": "false", 2019-12-22T22:31:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_nosizechange": "false", 2019-12-22T22:31:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flags": "0", 2019-12-22T22:31:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2019-12-22T22:31:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_min_size": "2", 2019-12-22T22:31:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2019-12-22T22:31:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_pg_num": "16", 2019-12-22T22:31:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_pgp_num": "0", 2019-12-22T22:31:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2019-12-22T22:31:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_size": "3", 2019-12-22T22:31:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_type": "replicated", 2019-12-22T22:31:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2019-12-22T22:31:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_use_gmt_hitset": "true", 2019-12-22T22:31:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_push_per_object_cost": "1000", 2019-12-22T22:31:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_read_ec_check_for_errors": "false", 2019-12-22T22:31:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recover_clone_overlap": "true", 2019-12-22T22:31:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recover_clone_overlap_limit": "10", 2019-12-22T22:31:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_cost": "20971520", 2019-12-22T22:31:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_delay_start": "0.000000", 2019-12-22T22:31:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_active": "0", 2019-12-22T22:31:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_active_hdd": "3", 2019-12-22T22:31:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_active_ssd": "10", 2019-12-22T22:31:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_chunk": "8388608", 2019-12-22T22:31:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2019-12-22T22:31:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_single_start": "1", 2019-12-22T22:31:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_op_priority": "3", 2019-12-22T22:31:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_op_warn_multiple": "16", 2019-12-22T22:31:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_priority": "5", 2019-12-22T22:31:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_retry_interval": "30.000000", 2019-12-22T22:31:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep": "0.000000", 2019-12-22T22:31:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep_hdd": "0.100000", 2019-12-22T22:31:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2019-12-22T22:31:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep_ssd": "0.000000", 2019-12-22T22:31:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_repair_during_recovery": "false", 2019-12-22T22:31:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_requested_scrub_priority": "120", 2019-12-22T22:31:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_rollback_to_cluster_snap": "", 2019-12-22T22:31:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_auto_repair": "false", 2019-12-22T22:31:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_auto_repair_num_errors": "5", 2019-12-22T22:31:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_backoff_ratio": "0.660000", 2019-12-22T22:31:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_begin_hour": "0", 2019-12-22T22:31:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_begin_week_day": "0", 2019-12-22T22:31:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_chunk_max": "25", 2019-12-22T22:31:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_chunk_min": "5", 2019-12-22T22:31:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_cost": "52428800", 2019-12-22T22:31:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_during_recovery": "false", 2019-12-22T22:31:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_end_hour": "24", 2019-12-22T22:31:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_end_week_day": "7", 2019-12-22T22:31:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_extended_sleep": "0.000000", 2019-12-22T22:31:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2019-12-22T22:31:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_invalid_stats": "true", 2019-12-22T22:31:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_load_threshold": "0.500000", 2019-12-22T22:31:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_max_interval": "604800.000000", 2019-12-22T22:31:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_max_preemptions": "5", 2019-12-22T22:31:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_min_interval": "86400.000000", 2019-12-22T22:31:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_priority": "5", 2019-12-22T22:31:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_sleep": "0.000000", 2019-12-22T22:31:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_shutdown_pgref_assert": "false", 2019-12-22T22:31:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_skip_data_digest": "false", 2019-12-22T22:31:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_smart_report_timeout": "5", 2019-12-22T22:31:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_cost": "1048576", 2019-12-22T22:31:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_priority": "5", 2019-12-22T22:31:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep": "0.000000", 2019-12-22T22:31:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2019-12-22T22:31:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2019-12-22T22:31:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2019-12-22T22:31:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_stats_ack_timeout_decay": "0.900000", 2019-12-22T22:31:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_stats_ack_timeout_factor": "2.000000", 2019-12-22T22:31:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_target_transaction_size": "30", 2019-12-22T22:31:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_count": "4", 2019-12-22T22:31:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2019-12-22T22:31:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2019-12-22T22:31:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2019-12-22T22:31:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2019-12-22T22:31:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2019-12-22T22:31:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2019-12-22T22:31:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_mode": "writeback", 2019-12-22T22:31:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2019-12-22T22:31:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_promote_max_objects_sec": "25", 2019-12-22T22:31:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tracing": "false", 2019-12-22T22:31:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_use_stale_snap": "false", 2019-12-22T22:31:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2019-12-22T22:31:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "osdc_blkin_trace_all": "false", 2019-12-22T22:31:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_kill_at": "0", 2019-12-22T22:31:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_max_join_drift": "10", 2019-12-22T22:31:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_min": "500", 2019-12-22T22:31:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_min_wait": "0.050000", 2019-12-22T22:31:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_propose_interval": "1.000000", 2019-12-22T22:31:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_service_trim_max": "500", 2019-12-22T22:31:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_service_trim_min": "10", 2019-12-22T22:31:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_stash_full_interval": "25", 2019-12-22T22:31:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_trim_max": "500", 2019-12-22T22:31:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_trim_min": "250", 2019-12-22T22:31:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "perf": "true", 2019-12-22T22:31:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: "pid_file": "", 2019-12-22T22:31:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: "plugin_crypto_accelerator": "crypto_isal", 2019-12-22T22:31:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "plugin_dir": "/usr/lib64/ceph", 2019-12-22T22:31:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "prompt": "\u001b[01;33mCephFS:~\u001b[96m/\u001b[0m\u001b[01;33m>>>\u001b[00m ", 2019-12-22T22:31:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "-", 2019-12-22T22:31:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrv": "", 2019-12-22T22:31:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "public_bind_addr": "-", 2019-12-22T22:31:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "public_network": "", 2019-12-22T22:31:26.509 INFO:teuthology.orchestra.run.smithi071.stdout: "public_network_interface": "", 2019-12-22T22:31:26.509 INFO:teuthology.orchestra.run.smithi071.stdout: "qat_compressor_enabled": "false", 2019-12-22T22:31:26.509 INFO:teuthology.orchestra.run.smithi071.stdout: "quiet": "false", 2019-12-22T22:31:26.509 INFO:teuthology.orchestra.run.smithi071.stdout: "rados_mon_op_timeout": "0.000000", 2019-12-22T22:31:26.509 INFO:teuthology.orchestra.run.smithi071.stdout: "rados_osd_op_timeout": "0.000000", 2019-12-22T22:31:26.509 INFO:teuthology.orchestra.run.smithi071.stdout: "rados_tracing": "false", 2019-12-22T22:31:26.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_atime_update_interval": "60", 2019-12-22T22:31:26.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2019-12-22T22:31:26.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_balance_parent_reads": "false", 2019-12-22T22:31:26.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_balance_snap_reads": "false", 2019-12-22T22:31:26.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_blacklist_expire_seconds": "0", 2019-12-22T22:31:26.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_blacklist_on_break_lock": "true", 2019-12-22T22:31:26.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_blkin_trace_all": "false", 2019-12-22T22:31:26.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache": "true", 2019-12-22T22:31:26.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_block_writes_upfront": "false", 2019-12-22T22:31:26.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_max_dirty": "25165824", 2019-12-22T22:31:26.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_max_dirty_age": "1.000000", 2019-12-22T22:31:26.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_max_dirty_object": "0", 2019-12-22T22:31:26.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_policy": "writearound", 2019-12-22T22:31:26.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_size": "33554432", 2019-12-22T22:31:26.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_target_dirty": "16777216", 2019-12-22T22:31:26.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_writethrough_until_flush": "true", 2019-12-22T22:31:26.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_clone_copy_on_read": "false", 2019-12-22T22:31:26.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_concurrent_management_ops": "10", 2019-12-22T22:31:26.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_clone_format": "auto", 2019-12-22T22:31:26.513 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_data_pool": "", 2019-12-22T22:31:26.513 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_features": "61", 2019-12-22T22:31:26.513 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_format": "2", 2019-12-22T22:31:26.513 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_map_options": "", 2019-12-22T22:31:26.513 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_order": "22", 2019-12-22T22:31:26.513 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_pool": "rbd", 2019-12-22T22:31:26.514 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_stripe_count": "0", 2019-12-22T22:31:26.514 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_stripe_unit": "0", 2019-12-22T22:31:26.514 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_disable_zero_copy_writes": "true", 2019-12-22T22:31:26.514 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_discard_granularity_bytes": "65536", 2019-12-22T22:31:26.514 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_discard_on_zeroed_write_same": "true", 2019-12-22T22:31:26.514 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_enable_alloc_hint": "true", 2019-12-22T22:31:26.514 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_io_scheduler": "simple", 2019-12-22T22:31:26.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2019-12-22T22:31:26.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_commit_age": "5.000000", 2019-12-22T22:31:26.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2019-12-22T22:31:26.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_max_payload_bytes": "16384", 2019-12-22T22:31:26.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_flush_age": "0.000000", 2019-12-22T22:31:26.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_flush_bytes": "1048576", 2019-12-22T22:31:26.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_flush_interval": "0", 2019-12-22T22:31:26.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2019-12-22T22:31:26.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2019-12-22T22:31:26.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_order": "24", 2019-12-22T22:31:26.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_pool": "", 2019-12-22T22:31:26.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_splay_width": "4", 2019-12-22T22:31:26.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_localize_parent_reads": "false", 2019-12-22T22:31:26.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_localize_snap_reads": "false", 2019-12-22T22:31:26.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2019-12-22T22:31:26.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2019-12-22T22:31:26.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2019-12-22T22:31:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2019-12-22T22:31:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2019-12-22T22:31:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2019-12-22T22:31:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_type": "simple", 2019-12-22T22:31:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2019-12-22T22:31:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_state_check_interval": "30", 2019-12-22T22:31:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2019-12-22T22:31:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2019-12-22T22:31:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2019-12-22T22:31:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2019-12-22T22:31:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2019-12-22T22:31:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_autotune": "true", 2019-12-22T22:31:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_base": "805306368", 2019-12-22T22:31:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2019-12-22T22:31:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_cache_min": "134217728", 2019-12-22T22:31:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2019-12-22T22:31:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2019-12-22T22:31:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_target": "4294967296", 2019-12-22T22:31:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_perf_stats_prio": "5", 2019-12-22T22:31:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2019-12-22T22:31:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2019-12-22T22:31:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_delete_delay": "0", 2019-12-22T22:31:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_max_mirroring_snapshots": "3", 2019-12-22T22:31:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_replay_delay": "0", 2019-12-22T22:31:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2019-12-22T22:31:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2019-12-22T22:31:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_move_to_trash_on_remove": "false", 2019-12-22T22:31:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2019-12-22T22:31:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mtime_update_interval": "60", 2019-12-22T22:31:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_non_blocking_aio": "true", 2019-12-22T22:31:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_op_thread_timeout": "60", 2019-12-22T22:31:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_op_threads": "1", 2019-12-22T22:31:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_parent_cache_enabled": "false", 2019-12-22T22:31:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_bps_burst": "0", 2019-12-22T22:31:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_bps_limit": "0", 2019-12-22T22:31:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_iops_burst": "0", 2019-12-22T22:31:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_iops_limit": "0", 2019-12-22T22:31:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_bps_burst": "0", 2019-12-22T22:31:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_bps_limit": "0", 2019-12-22T22:31:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_iops_burst": "0", 2019-12-22T22:31:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_iops_limit": "0", 2019-12-22T22:31:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_schedule_tick_min": "50", 2019-12-22T22:31:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_bps_burst": "0", 2019-12-22T22:31:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_bps_limit": "0", 2019-12-22T22:31:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_iops_burst": "0", 2019-12-22T22:31:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_iops_limit": "0", 2019-12-22T22:31:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2019-12-22T22:31:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_readahead_max_bytes": "524288", 2019-12-22T22:31:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_readahead_trigger_requests": "10", 2019-12-22T22:31:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_request_timed_out_seconds": "30", 2019-12-22T22:31:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_rwl_enabled": "false", 2019-12-22T22:31:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_rwl_log_periodic_stats": "false", 2019-12-22T22:31:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_rwl_path": "/tmp", 2019-12-22T22:31:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_rwl_size": "1073741824", 2019-12-22T22:31:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_skip_partial_discard": "true", 2019-12-22T22:31:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2019-12-22T22:31:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_tracing": "false", 2019-12-22T22:31:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_validate_names": "true", 2019-12-22T22:31:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_validate_pool": "true", 2019-12-22T22:31:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "restapi_base_url": "", 2019-12-22T22:31:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "restapi_log_level": "", 2019-12-22T22:31:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_acl_grants_max_num": "100", 2019-12-22T22:31:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_admin_entry": "admin", 2019-12-22T22:31:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_barbican_url": "", 2019-12-22T22:31:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2019-12-22T22:31:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_default_quota_max_size": "-1", 2019-12-22T22:31:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_index_max_aio": "128", 2019-12-22T22:31:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_quota_cache_size": "10000", 2019-12-22T22:31:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_quota_soft_threshold": "0.950000", 2019-12-22T22:31:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_quota_ttl": "600", 2019-12-22T22:31:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cache_enabled": "true", 2019-12-22T22:31:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cache_expiry_interval": "900", 2019-12-22T22:31:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cache_lru_size": "10000", 2019-12-22T22:31:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_content_length_compat": "false", 2019-12-22T22:31:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_copy_obj_progress": "true", 2019-12-22T22:31:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2019-12-22T22:31:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cors_rules_max_num": "100", 2019-12-22T22:31:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cross_domain_policy": "", 2019-12-22T22:31:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_default_encryption_key": "", 2019-12-22T22:31:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_require_ssl": "true", 2019-12-22T22:31:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2019-12-22T22:31:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2019-12-22T22:31:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_suppress_logs": "true", 2019-12-22T22:31:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_addr": "", 2019-12-22T22:31:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_auth": "token", 2019-12-22T22:31:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_namespace": "", 2019-12-22T22:31:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_prefix": "", 2019-12-22T22:31:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_secret_engine": "transit", 2019-12-22T22:31:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_token_file": "", 2019-12-22T22:31:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_low_speed_limit": "1024", 2019-12-22T22:31:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_low_speed_time": "300", 2019-12-22T22:31:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_wait_timeout_ms": "1000", 2019-12-22T22:31:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2019-12-22T22:31:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_changes_size": "1000", 2019-12-22T22:31:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_num_shards": "128", 2019-12-22T22:31:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_obj_prefix": "data_log", 2019-12-22T22:31:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_window": "30", 2019-12-22T22:31:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_notify_interval_msec": "200", 2019-12-22T22:31:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_realm_info_oid": "default.realm", 2019-12-22T22:31:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_region_info_oid": "default.region", 2019-12-22T22:31:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_zone_info_oid": "default.zone", 2019-12-22T22:31:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2019-12-22T22:31:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_defer_to_bucket_acls": "", 2019-12-22T22:31:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_delete_multi_obj_max_num": "1000", 2019-12-22T22:31:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_admin_lim": "0.000000", 2019-12-22T22:31:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_admin_res": "100.000000", 2019-12-22T22:31:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2019-12-22T22:31:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_auth_lim": "0.000000", 2019-12-22T22:31:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_auth_res": "200.000000", 2019-12-22T22:31:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2019-12-22T22:31:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_data_lim": "0.000000", 2019-12-22T22:31:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_data_res": "500.000000", 2019-12-22T22:31:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_data_wgt": "500.000000", 2019-12-22T22:31:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2019-12-22T22:31:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_metadata_res": "500.000000", 2019-12-22T22:31:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2019-12-22T22:31:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dns_name": "", 2019-12-22T22:31:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dns_s3website_name": "", 2019-12-22T22:31:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dynamic_resharding": "true", 2019-12-22T22:31:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, pubsub", 2019-12-22T22:31:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_gc_threads": "true", 2019-12-22T22:31:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_lc_threads": "true", 2019-12-22T22:31:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_ops_log": "false", 2019-12-22T22:31:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_quota_threads": "true", 2019-12-22T22:31:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_static_website": "false", 2019-12-22T22:31:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_usage_log": "false", 2019-12-22T22:31:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enforce_swift_acls": "true", 2019-12-22T22:31:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_exit_timeout_secs": "120", 2019-12-22T22:31:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_expose_bucket": "false", 2019-12-22T22:31:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_extended_http_attrs": "", 2019-12-22T22:31:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_fcgi_socket_backlog": "1024", 2019-12-22T22:31:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_frontends": "beast port=7480", 2019-12-22T22:31:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_concurrent_io": "10", 2019-12-22T22:31:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_deferred": "50", 2019-12-22T22:31:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2019-12-22T22:31:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_objs": "32", 2019-12-22T22:31:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_queue_size": "134213632", 2019-12-22T22:31:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_trim_chunk": "16", 2019-12-22T22:31:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_obj_min_wait": "7200", 2019-12-22T22:31:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_processor_max_time": "3600", 2019-12-22T22:31:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_processor_period": "3600", 2019-12-22T22:31:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_get_obj_max_req_size": "4194304", 2019-12-22T22:31:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_get_obj_window_size": "16777216", 2019-12-22T22:31:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_healthcheck_disabling_path": "", 2019-12-22T22:31:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_host": "", 2019-12-22T22:31:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ignore_get_invalid_range": "false", 2019-12-22T22:31:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_init_timeout": "300", 2019-12-22T22:31:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2019-12-22T22:31:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_accepted_admin_roles": "", 2019-12-22T22:31:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2019-12-22T22:31:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_domain": "", 2019-12-22T22:31:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_password": "", 2019-12-22T22:31:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_password_path": "", 2019-12-22T22:31:26.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_project": "", 2019-12-22T22:31:26.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_tenant": "", 2019-12-22T22:31:26.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_token": "", 2019-12-22T22:31:26.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_token_path": "", 2019-12-22T22:31:26.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_user": "", 2019-12-22T22:31:26.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_api_version": "2", 2019-12-22T22:31:26.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_domain": "", 2019-12-22T22:31:26.544 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_password": "", 2019-12-22T22:31:26.544 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_project": "", 2019-12-22T22:31:26.545 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_tenant": "", 2019-12-22T22:31:26.545 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_user": "", 2019-12-22T22:31:26.545 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_implicit_tenants": "false", 2019-12-22T22:31:26.545 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_token_cache_size": "10000", 2019-12-22T22:31:26.545 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_url": "", 2019-12-22T22:31:26.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_verify_ssl": "true", 2019-12-22T22:31:26.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_debug_interval": "-1", 2019-12-22T22:31:26.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_lock_max_time": "60", 2019-12-22T22:31:26.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_objs": "32", 2019-12-22T22:31:26.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_rules": "1000", 2019-12-22T22:31:26.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_thread_delay": "0", 2019-12-22T22:31:26.547 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2019-12-22T22:31:26.547 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_dnattr": "uid", 2019-12-22T22:31:26.547 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2019-12-22T22:31:26.547 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_searchfilter": "", 2019-12-22T22:31:26.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2019-12-22T22:31:26.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_uri": "ldaps://", 2019-12-22T22:31:26.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2019-12-22T22:31:26.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_list_bucket_min_readahead": "1000", 2019-12-22T22:31:26.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_list_buckets_max_chunk": "1000", 2019-12-22T22:31:26.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_http_headers": "", 2019-12-22T22:31:26.549 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_nonexistent_bucket": "false", 2019-12-22T22:31:26.549 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2019-12-22T22:31:26.549 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_object_name_utc": "false", 2019-12-22T22:31:26.549 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_attr_name_len": "0", 2019-12-22T22:31:26.549 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_attr_size": "0", 2019-12-22T22:31:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_attrs_num_in_req": "0", 2019-12-22T22:31:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_chunk_size": "4194304", 2019-12-22T22:31:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_concurrent_requests": "1024", 2019-12-22T22:31:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_dynamic_shards": "1999", 2019-12-22T22:31:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_listing_results": "1000", 2019-12-22T22:31:26.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_notify_retries": "3", 2019-12-22T22:31:26.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_objs_per_shard": "100000", 2019-12-22T22:31:26.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_put_param_size": "1048576", 2019-12-22T22:31:26.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_put_size": "5368709120", 2019-12-22T22:31:26.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_slo_entries": "1000", 2019-12-22T22:31:26.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_md_log_max_shards": "64", 2019-12-22T22:31:26.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_md_notify_interval_msec": "200", 2019-12-22T22:31:26.552 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_mime_types_file": "/etc/mime.types", 2019-12-22T22:31:26.552 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_mp_lock_max_time": "600", 2019-12-22T22:31:26.552 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_multipart_min_part_size": "5242880", 2019-12-22T22:31:26.552 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_multipart_part_upload_limit": "10000", 2019-12-22T22:31:26.552 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_fhcache_partitions": "3", 2019-12-22T22:31:26.552 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_fhcache_size": "2017", 2019-12-22T22:31:26.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2019-12-22T22:31:26.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_lru_lanes": "5", 2019-12-22T22:31:26.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_max_gc": "300", 2019-12-22T22:31:26.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_namespace_expire_secs": "300", 2019-12-22T22:31:26.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_s3_fast_attrs": "false", 2019-12-22T22:31:26.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_write_completion_interval_s": "10", 2019-12-22T22:31:26.554 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_num_async_rados_threads": "32", 2019-12-22T22:31:26.554 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_num_control_oids": "8", 2019-12-22T22:31:26.554 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_num_rados_handles": "1", 2019-12-22T22:31:26.554 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_obj_stripe_size": "4194304", 2019-12-22T22:31:26.554 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_obj_tombstone_cache_size": "1000", 2019-12-22T22:31:26.554 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_objexp_chunk_size": "100", 2019-12-22T22:31:26.555 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_objexp_gc_interval": "600", 2019-12-22T22:31:26.555 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_objexp_hints_num_shards": "127", 2019-12-22T22:31:26.555 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_olh_pending_timeout_sec": "3600", 2019-12-22T22:31:26.555 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_op_thread_suicide_timeout": "0", 2019-12-22T22:31:26.555 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_op_thread_timeout": "600", 2019-12-22T22:31:26.555 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_op_tracing": "false", 2019-12-22T22:31:26.556 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_opa_token": "", 2019-12-22T22:31:26.556 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_opa_url": "", 2019-12-22T22:31:26.556 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_opa_verify_ssl": "true", 2019-12-22T22:31:26.556 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_data_backlog": "5242880", 2019-12-22T22:31:26.556 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_rados": "true", 2019-12-22T22:31:26.557 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_socket_path": "", 2019-12-22T22:31:26.557 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_override_bucket_index_max_shards": "0", 2019-12-22T22:31:26.557 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2019-12-22T22:31:26.557 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_push_interval": "2.000000", 2019-12-22T22:31:26.557 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_push_interval_max": "30.000000", 2019-12-22T22:31:26.557 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_root_pool": ".rgw.root", 2019-12-22T22:31:26.558 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_port": "", 2019-12-22T22:31:26.558 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_print_continue": "true", 2019-12-22T22:31:26.558 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_print_prohibited_content_length": "false", 2019-12-22T22:31:26.558 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_put_obj_max_window_size": "67108864", 2019-12-22T22:31:26.558 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_put_obj_min_window_size": "16777216", 2019-12-22T22:31:26.558 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2019-12-22T22:31:26.558 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_pool_pg_num_min": "8", 2019-12-22T22:31:26.559 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_pool_recovery_priority": "5", 2019-12-22T22:31:26.559 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_tracing": "false", 2019-12-22T22:31:26.559 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_realm": "", 2019-12-22T22:31:26.559 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_realm_root_pool": ".rgw.root", 2019-12-22T22:31:26.559 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_region": "", 2019-12-22T22:31:26.559 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_region_root_pool": ".rgw.root", 2019-12-22T22:31:26.559 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_relaxed_region_enforcement": "false", 2019-12-22T22:31:26.560 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_relaxed_s3_bucket_names": "false", 2019-12-22T22:31:26.560 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2019-12-22T22:31:26.560 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_request_uri": "", 2019-12-22T22:31:26.560 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_batch_size": "64", 2019-12-22T22:31:26.560 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_bucket_lock_duration": "360", 2019-12-22T22:31:26.560 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_max_aio": "128", 2019-12-22T22:31:26.560 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_num_logs": "16", 2019-12-22T22:31:26.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_thread_interval": "600", 2019-12-22T22:31:26.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_resolve_cname": "false", 2019-12-22T22:31:26.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rest_getusage_op_compat": "false", 2019-12-22T22:31:26.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_run_sync_thread": "true", 2019-12-22T22:31:26.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_order": "sts, external, local", 2019-12-22T22:31:26.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_keystone": "false", 2019-12-22T22:31:26.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_ldap": "false", 2019-12-22T22:31:26.562 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_rados": "true", 2019-12-22T22:31:26.562 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_sts": "false", 2019-12-22T22:31:26.562 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_success_create_obj_status": "0", 2019-12-22T22:31:26.562 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_safe_max_objects_per_shard": "102400", 2019-12-22T22:31:26.562 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_scheduler_type": "throttler", 2019-12-22T22:31:26.562 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_script_uri": "", 2019-12-22T22:31:26.562 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_service_provider_name": "", 2019-12-22T22:31:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_shard_warning_threshold": "90.000000", 2019-12-22T22:31:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_socket_path": "", 2019-12-22T22:31:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_client_id": "", 2019-12-22T22:31:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_client_secret": "", 2019-12-22T22:31:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_entry": "sts", 2019-12-22T22:31:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_key": "sts", 2019-12-22T22:31:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_max_session_duration": "43200", 2019-12-22T22:31:26.563 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_token_introspection_url": "", 2019-12-22T22:31:26.564 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_account_in_url": "false", 2019-12-22T22:31:26.564 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_auth_entry": "auth", 2019-12-22T22:31:26.564 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_auth_url": "", 2019-12-22T22:31:26.564 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_custom_header": "", 2019-12-22T22:31:26.564 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_enforce_content_length": "false", 2019-12-22T22:31:26.564 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_need_stats": "true", 2019-12-22T22:31:26.564 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_tenant_name": "", 2019-12-22T22:31:26.565 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_token_expiration": "86400", 2019-12-22T22:31:26.565 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_url": "", 2019-12-22T22:31:26.565 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_url_prefix": "swift", 2019-12-22T22:31:26.565 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_versioning_enabled": "false", 2019-12-22T22:31:26.565 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2019-12-22T22:31:26.565 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_lease_period": "120", 2019-12-22T22:31:26.565 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2019-12-22T22:31:26.566 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_interval": "1200", 2019-12-22T22:31:26.566 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_max_buckets": "16", 2019-12-22T22:31:26.566 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2019-12-22T22:31:26.566 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2019-12-22T22:31:26.566 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_trace_history_size": "4096", 2019-12-22T22:31:26.566 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_trace_per_node_log_size": "32", 2019-12-22T22:31:26.566 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2019-12-22T22:31:26.567 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_thread_pool_size": "512", 2019-12-22T22:31:26.567 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_comment": "", 2019-12-22T22:31:26.567 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_createby": "", 2019-12-22T22:31:26.567 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_encoding": "", 2019-12-22T22:31:26.567 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_flag": "false", 2019-12-22T22:31:26.567 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_origin": "", 2019-12-22T22:31:26.568 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_sha_unit": "524288", 2019-12-22T22:31:26.568 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_tracker": "", 2019-12-22T22:31:26.568 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_trust_forwarded_https": "false", 2019-12-22T22:31:26.568 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_log_flush_threshold": "1024", 2019-12-22T22:31:26.568 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_log_tick_interval": "30", 2019-12-22T22:31:26.569 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_max_shards": "32", 2019-12-22T22:31:26.569 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_max_user_shards": "1", 2019-12-22T22:31:26.569 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_use_opa_authz": "false", 2019-12-22T22:31:26.569 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_default_quota_max_objects": "-1", 2019-12-22T22:31:26.569 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_default_quota_max_size": "-1", 2019-12-22T22:31:26.569 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_max_buckets": "1000", 2019-12-22T22:31:26.569 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2019-12-22T22:31:26.570 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_sync_idle_users": "false", 2019-12-22T22:31:26.570 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_sync_interval": "86400", 2019-12-22T22:31:26.570 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_sync_wait_time": "86400", 2019-12-22T22:31:26.570 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_unique_email": "true", 2019-12-22T22:31:26.570 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_verify_ssl": "true", 2019-12-22T22:31:26.570 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_website_routing_rules_max_num": "50", 2019-12-22T22:31:26.570 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zone": "", 2019-12-22T22:31:26.571 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zone_root_pool": ".rgw.root", 2019-12-22T22:31:26.571 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zonegroup": "", 2019-12-22T22:31:26.571 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2019-12-22T22:31:26.571 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_block_size": "4096", 2019-12-22T22:31:26.571 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_bloom_bits_per_key": "20", 2019-12-22T22:31:26.571 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2019-12-22T22:31:26.571 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "true", 2019-12-22T22:31:26.572 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_row_ratio": "0.000000", 2019-12-22T22:31:26.572 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_shard_bits": "4", 2019-12-22T22:31:26.572 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_size": "536870912", 2019-12-22T22:31:26.572 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_type": "binned_lru", 2019-12-22T22:31:26.572 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_collect_compaction_stats": "false", 2019-12-22T22:31:26.572 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_collect_extended_stats": "false", 2019-12-22T22:31:26.572 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_collect_memory_stats": "false", 2019-12-22T22:31:26.573 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_delete_range_threshold": "1024", 2019-12-22T22:31:26.573 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_index_type": "binary_search", 2019-12-22T22:31:26.573 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_log_to_ceph_log": "true", 2019-12-22T22:31:26.573 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_metadata_block_size": "4096", 2019-12-22T22:31:26.573 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_partition_filters": "false", 2019-12-22T22:31:26.573 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_perf": "false", 2019-12-22T22:31:26.573 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2019-12-22T22:31:26.574 INFO:teuthology.orchestra.run.smithi071.stdout: "rotating_keys_bootstrap_timeout": "30", 2019-12-22T22:31:26.574 INFO:teuthology.orchestra.run.smithi071.stdout: "rotating_keys_renewal_timeout": "10", 2019-12-22T22:31:26.574 INFO:teuthology.orchestra.run.smithi071.stdout: "run_dir": "/var/run/ceph", 2019-12-22T22:31:26.574 INFO:teuthology.orchestra.run.smithi071.stdout: "setgroup": "ceph", 2019-12-22T22:31:26.574 INFO:teuthology.orchestra.run.smithi071.stdout: "setuser": "ceph", 2019-12-22T22:31:26.574 INFO:teuthology.orchestra.run.smithi071.stdout: "setuser_match_path": "", 2019-12-22T22:31:26.574 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_misplaced_ratio": "0.050000", 2019-12-22T22:31:26.574 INFO:teuthology.orchestra.run.smithi071.stdout: "thp": "false", 2019-12-22T22:31:26.575 INFO:teuthology.orchestra.run.smithi071.stdout: "threadpool_default_timeout": "60", 2019-12-22T22:31:26.575 INFO:teuthology.orchestra.run.smithi071.stdout: "threadpool_empty_queue_max_wait": "2", 2019-12-22T22:31:26.575 INFO:teuthology.orchestra.run.smithi071.stdout: "throttler_perf_counter": "true", 2019-12-22T22:31:26.575 INFO:teuthology.orchestra.run.smithi071.stdout: "timing": "false" 2019-12-22T22:31:26.575 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:31:26.871 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2019-12-22T22:31:28.927 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a: {} 2019-12-22T22:31:28.957 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c: {} 2019-12-22T22:31:28.987 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b: {} 2019-12-22T22:31:28.989 INFO:teuthology.orchestra.run.smithi071.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2019-12-22T22:31:28.989 INFO:teuthology.orchestra.run.smithi071.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2019-12-22T22:31:28.989 INFO:teuthology.orchestra.run.smithi071.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2019-12-22T22:31:29.591 INFO:teuthology.orchestra.run.smithi071:> type ceph-objectstore-tool 2019-12-22T22:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2019-12-22T22:31:29.717 INFO:teuthology.orchestra.run.smithi187:> type ceph-objectstore-tool 2019-12-22T22:31:29.825 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2019-12-22T22:31:29.826 INFO:teuthology.orchestra.run.smithi168:> type ceph-objectstore-tool 2019-12-22T22:31:29.965 INFO:teuthology.orchestra.run.smithi168.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2019-12-22T22:31:29.965 INFO:teuthology.run_tasks:Running task sleep... 2019-12-22T22:31:29.981 INFO:teuthology.task.sleep:Sleeping for 600000 seconds 2019-12-22T22:31:29.982 INFO:tasks.thrashosds.thrasher:starting do_thrash 2019-12-22T22:31:29.982 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] out_osds: [] dead_osds: [] live_osds: [11, 10, 1, 0, 3, 2, 5, 4, 7, 6, 9, 8] 2019-12-22T22:31:29.982 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2019-12-22T22:31:29.982 INFO:tasks.thrashosds.thrasher:inject_pause on 6 2019-12-22T22:31:29.982 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2019-12-22T22:31:29.983 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2019-12-22T22:31:29.983 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:31:29.988 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2019-12-22T22:31:29.990 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 992, in wrapper return func(self) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 1009, in do_sighup self.ceph_manager.signal_osd(osd, signal.SIGHUP, silent=True) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 2707, in signal_osd self.cluster).signal(sig, silent=silent) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/cephadmunit.py", line 95, in signal raise NotImplementedError NotImplementedError 2019-12-22T22:31:29.992 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 992, in wrapper return func(self) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 1009, in do_sighup self.ceph_manager.signal_osd(osd, signal.SIGHUP, silent=True) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 2707, in signal_osd self.cluster).signal(sig, silent=silent) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/cephadmunit.py", line 95, in signal raise NotImplementedError NotImplementedError 2019-12-22T22:31:29.993 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2019-12-22T22:31:29.993 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:31:29.994 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2019-12-22T22:31:29.994 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:31:29.995 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2019-12-22T22:31:29.995 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:31:33.512 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:31:33.985 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:31:34.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:31:34.434 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:31:34.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:31:34.899 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:31:34.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:31:34.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:31:34.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:31:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:31:35.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:31:35.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:31:35.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:31:35.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:31:35.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:31:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:31:35.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:31:35.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:31:35.518 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:31:35.519 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:31:36.973 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:31:37.462 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:31:37.819 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:31:38.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:31:38.163 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:31:39.435 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:31:40.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:31:40.980 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:31:41.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:31:41.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:31:41.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:31:41.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:31:41.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:31:41.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:31:41.151 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:31:41.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:31:41.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:31:41.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:31:41.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:31:41.244 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.244 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.244 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.244 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.244 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.244 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.245 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.245 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.245 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.245 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.245 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.245 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:31:41.913 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:31:42.730 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:31:42.731 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:31:43.044 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:31:43.871 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:31:43.871 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:31:44.127 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:31:44.449 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:31:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:31:45.944 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:31:45.945 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:31:47.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:31:47.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:31:47.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:31:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:31:47.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:31:47.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:31:47.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:31:47.955 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:31:47.970 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:31:47.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:31:48.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:31:48.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:31:48.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:31:48.077 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.079 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.079 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.079 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.079 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.079 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:31:48.773 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:31:48.872 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:31:49.489 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:31:49.489 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:31:50.842 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:31:51.033 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:31:51.298 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:31:52.062 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:31:52.062 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:31:53.196 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:31:53.974 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:31:53.975 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:31:54.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:31:54.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:31:54.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:31:54.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:31:54.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:31:54.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:31:54.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:31:54.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:31:54.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:31:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:31:56.586 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:31:56.586 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:31:56.586 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:31:56.586 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:31:57.064 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:31:57.186 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:31:58.032 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:31:58.033 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:32:00.739 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:32:00.739 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:32:00.739 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:32:00.739 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:32:00.740 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:32:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:01.596 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:32:01.899 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:01.900 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:32:02.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:32:02.075 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:32:02.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:32:02.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:32:02.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:32:02.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:32:02.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:32:02.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:32:02.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:32:02.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:32:02.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:32:02.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:32:02.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:32:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:32:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:32:04.864 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:32:05.193 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:32:05.884 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:32:06.901 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:32:07.582 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:32:08.852 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:32:09.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:32:09.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:32:09.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:32:09.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:32:09.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:32:09.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:32:09.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:32:09.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:32:09.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:32:09.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:32:09.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:32:09.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:32:09.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.296 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.296 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:32:09.296 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:32:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:10.990 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:32:11.770 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:11.771 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:32:12.088 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:32:12.249 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:32:12.249 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:32:12.249 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:32:12.249 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:32:12.249 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:32:12.822 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:32:14.005 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:32:15.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:32:15.255 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:32:15.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:32:15.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:32:15.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:32:15.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:32:15.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:32:15.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:32:15.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:32:15.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:32:15.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:32:15.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:32:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:32:15.745 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:32:16.711 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:32:16.772 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:32:17.981 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:32:18.386 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:32:19.764 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:32:20.350 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:20.798 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:32:20.949 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:20.949 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:32:21.078 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:32:21.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:32:21.609 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:32:21.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:32:21.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:32:21.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:32:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:32:21.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:32:21.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:32:21.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:32:21.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:32:21.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:32:21.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:32:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:32:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:32:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:32:23.648 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:32:23.648 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:32:23.649 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:32:23.649 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:32:24.316 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:32:24.943 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:32:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:32:25.950 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:32:26.734 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:32:26.734 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:32:26.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:32:26.734 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:32:26.734 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:32:27.760 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:32:27.829 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:32:28.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:32:28.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:32:28.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:32:28.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:32:28.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:32:28.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:32:28.870 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:32:28.897 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:32:28.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:32:28.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:32:28.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:32:29.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:32:29.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:32:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:32:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:30.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:30.837 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:32:31.654 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:32:31.769 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:32:32.011 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:32:32.405 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:32:34.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:32:34.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:32:34.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:32:34.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:32:34.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:32:34.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:32:34.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:32:34.868 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:32:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:32:34.869 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:32:34.869 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:32:34.869 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:32:34.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:32:34.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:32:34.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:32:34.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:32:34.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:32:34.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:32:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:32:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:32:35.707 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:32:35.837 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:32:37.958 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:32:38.759 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:32:38.759 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:32:38.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:32:38.759 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:32:38.760 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:32:38.998 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:32:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:39.819 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:32:40.835 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:40.835 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:32:41.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:32:41.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:32:41.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:32:41.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:32:41.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:32:41.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:32:41.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:32:41.673 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:32:41.699 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:32:41.726 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:32:41.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:32:41.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:32:41.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.783 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.783 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:32:41.783 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:32:42.173 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:32:42.853 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:43.529 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:43.530 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:32:44.440 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:32:45.836 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:32:45.987 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:32:46.140 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:46.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:46.906 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:32:48.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:32:48.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:32:48.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:32:48.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:32:48.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:32:48.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:32:48.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:32:48.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:32:48.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:32:48.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:32:48.418 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:32:48.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:32:48.445 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.445 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:32:48.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:32:49.160 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:49.357 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:32:49.830 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:49.831 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:32:50.501 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:51.312 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:32:51.421 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:51.421 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:32:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:32:54.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:32:54.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:32:54.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:32:54.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:32:54.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:32:54.264 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:54.301 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:32:54.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:32:54.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:32:54.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:32:54.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:32:54.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:32:54.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:32:54.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:32:54.832 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:32:54.875 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:54.875 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:32:55.711 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:32:57.247 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:32:58.065 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:58.263 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:32:59.481 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:59.482 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:32:59.654 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:32:59.655 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:33:00.171 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:33:00.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:33:00.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:33:00.909 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:33:00.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:33:00.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:33:01.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:33:01.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:33:01.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:33:01.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:33:01.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:33:01.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:33:01.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:33:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:02.899 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:02.900 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:33:02.965 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:33:03.881 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:33:04.482 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:33:06.752 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:06.997 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:33:07.628 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:07.628 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:33:07.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:33:07.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:33:07.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:33:07.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:33:07.883 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:33:07.909 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:33:07.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:33:07.962 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:33:07.988 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:33:08.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:33:08.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:33:08.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:33:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:33:08.419 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:09.380 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:09.380 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:33:10.148 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:33:10.306 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:10.967 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:33:11.042 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:11.043 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:33:13.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:33:13.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:33:13.967 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:33:14.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:33:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:33:14.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:33:14.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:33:14.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:33:14.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:33:14.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:33:14.381 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:33:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:15.185 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:15.185 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:33:16.632 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:33:17.488 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:33:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:18.350 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:18.865 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:18.865 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:33:19.171 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:19.171 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:33:21.178 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:33:21.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:33:21.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:33:21.355 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:33:21.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:33:21.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:33:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:33:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:33:21.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:33:21.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:33:21.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:33:21.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:33:21.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:33:21.656 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.656 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:33:21.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:33:22.206 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:22.739 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:22.740 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:33:23.866 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:33:23.889 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:33:24.322 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:33:25.310 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:26.726 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:26.726 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:33:27.358 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:28.295 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:28.296 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:33:28.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:33:28.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:33:28.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:33:28.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:33:28.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:33:28.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:33:28.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:33:28.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:33:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:33:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:33:29.015 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:33:30.337 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:30.966 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:30.966 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:33:31.696 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:33:31.934 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:33:33.297 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:33:33.740 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:34.944 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:34.945 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:33:35.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:33:35.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:33:35.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:33:35.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:33:35.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:33:35.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:33:35.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:33:35.575 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:33:35.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:33:35.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:33:35.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:33:35.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:33:35.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:33:35.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:33:36.002 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:33:37.700 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:38.362 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:38.363 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:33:38.657 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:33:38.740 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:38.772 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:33:39.015 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:33:41.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:33:41.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:33:41.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:33:41.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:33:41.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:33:41.705 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:33:41.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:33:41.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:33:41.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:33:41.873 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:41.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:33:41.891 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:33:41.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:33:42.656 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:42.656 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:33:43.364 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:33:43.600 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:33:44.814 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:33:45.492 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:46.491 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:33:46.520 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:46.521 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:33:47.068 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:48.171 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:48.172 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['config', 'set', 'filestore_inject_stall', '3'] 2019-12-22T22:33:49.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:33:49.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:33:49.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:33:49.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:33:49.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:33:49.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:33:49.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:33:49.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:33:49.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:33:49.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:33:49.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:33:49.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:33:49.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:33:49.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:33:50.507 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:33:51.112 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:51.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:33:52.261 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:33:53.173 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 config set filestore_inject_stall 3 2019-12-22T22:33:53.381 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:53.529 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:33:54.591 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:54.592 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:33:55.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:33:55.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:33:55.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:33:55.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:33:55.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:33:55.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:33:55.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:33:55.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:33:55.396 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:33:55.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:33:55.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:33:55.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:33:55.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:33:55.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:33:57.465 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:33:58.258 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:33:58.435 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:58.436 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 992, in wrapper return func(self) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 1122, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 957, in False), File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 819, in inject_pause self.ceph_manager.set_config(the_one, **{conf_key: duration}) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 1715, in set_config ['config', 'set', str(k), str(v)]) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 1673, in wait_run_admin_socket id=service_id)) Exception: timed out waiting for admin_socket to appear after osd.6 restart 2019-12-22T22:33:58.436 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 980, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 992, in wrapper return func(self) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 1122, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 957, in False), File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 819, in inject_pause self.ceph_manager.set_config(the_one, **{conf_key: duration}) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 1715, in set_config ['config', 'set', str(k), str(v)]) File "/home/teuthworker/src/github.com_liewegas_ceph_wip-old-clients-cephadm/qa/tasks/ceph_manager.py", line 1673, in wait_run_admin_socket id=service_id)) Exception: timed out waiting for admin_socket to appear after osd.6 restart 2019-12-22T22:33:58.761 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:33:59.038 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:33:59.039 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:34:00.894 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:34:01.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:01.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:01.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:01.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:01.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:01.357 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:01.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:01.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:01.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:01.489 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:01.513 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:34:01.515 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.518 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.518 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.518 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.518 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.519 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.519 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:34:01.519 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:34:02.392 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:34:02.392 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:34:04.571 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:34:04.694 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:34:05.015 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:34:05.168 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:34:05.169 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:34:07.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:07.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:07.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:07.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:07.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:07.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:07.857 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:34:07.875 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:07.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:07.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:07.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:07.982 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:34:08.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:08.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:34:08.811 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:34:08.811 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:34:11.092 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:34:11.400 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:34:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:34:12.178 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:34:12.179 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:34:14.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:14.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:14.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:14.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:14.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:14.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:14.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:14.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:14.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:14.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:14.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:14.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:34:14.791 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:34:14.929 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:34:15.438 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:34:16.974 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:34:18.022 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:34:18.059 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:34:19.226 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:34:19.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:19.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:19.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:19.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:19.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:19.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:19.909 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:19.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:19.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:20.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:20.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:20.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:20.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:34:20.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:34:21.227 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:34:21.521 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:34:21.522 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:34:21.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:34:21.522 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:34:21.522 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:34:22.184 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:34:22.925 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:34:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:34:25.127 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:34:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:34:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:34:25.128 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:34:26.004 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:34:26.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:26.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:26.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:26.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:26.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:26.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:26.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:26.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:26.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:26.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:26.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:26.685 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:34:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:34:27.723 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:34:28.366 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:34:29.162 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:34:29.536 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:34:31.076 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:34:32.135 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:34:32.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:32.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:32.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:32.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:32.825 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:34:32.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:32.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:32.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:32.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:32.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:32.988 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:33.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:33.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:34:33.907 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:34:35.299 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:34:35.300 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:34:35.300 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:34:35.300 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:34:35.760 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:34:36.064 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:34:37.021 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:34:38.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:38.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:38.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:38.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:38.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:38.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:38.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:38.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:39.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:39.018 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:34:39.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:39.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:39.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:39.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:34:39.817 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:34:40.075 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:34:42.000 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:34:42.325 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:34:43.179 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:34:43.180 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:34:45.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:45.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:45.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:45.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:45.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:45.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:45.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:45.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:45.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:45.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:45.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:45.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:45.558 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.558 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.558 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.558 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:34:45.912 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:34:46.092 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:34:46.092 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:34:46.092 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:34:46.092 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:34:46.551 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:34:48.147 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:34:48.895 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:34:48.895 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:34:48.896 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:34:48.896 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:34:48.896 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:34:49.059 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:34:49.574 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:34:51.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:51.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:51.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:51.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:51.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:51.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:51.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:51.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:51.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:51.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:51.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:51.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:51.672 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.672 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.672 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.674 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:34:51.674 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:34:52.241 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:34:52.273 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:34:52.768 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:34:54.255 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:34:55.077 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:34:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:34:56.236 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:34:56.236 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:34:57.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:34:57.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:34:57.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:34:57.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:34:57.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:34:57.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:34:57.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:34:57.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:34:57.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:34:57.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:34:57.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:34:57.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:34:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:34:57.862 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:34:58.771 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:34:59.461 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:34:59.462 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:35:00.643 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:35:01.183 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:35:02.367 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:02.956 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:02.957 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:35:03.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:35:03.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:35:03.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:35:03.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:35:03.438 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:35:03.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:35:03.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:35:03.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:35:03.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:35:03.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:35:03.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:35:03.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:35:03.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:35:03.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:35:04.027 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:35:05.451 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:06.296 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:06.297 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:35:06.471 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:35:07.049 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:35:09.123 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:09.761 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:09.761 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:35:10.232 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:35:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:12.633 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:12.633 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:35:14.202 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:35:14.947 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:15.464 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:15.465 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:35:16.868 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:35:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:18.131 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:18.131 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:35:19.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:35:19.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:35:19.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:35:19.300 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:35:19.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:35:19.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:35:19.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:35:19.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:35:19.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:35:19.522 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:35:19.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:35:19.575 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:35:19.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.578 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.578 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.578 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:35:19.578 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:35:20.038 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:35:21.047 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:21.646 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:21.647 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:35:22.161 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:35:22.794 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:35:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:25.571 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:25.571 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:35:25.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:35:25.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:35:25.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:35:25.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:35:25.766 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:35:25.793 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:35:25.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:35:25.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:35:25.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:35:25.899 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:35:25.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:35:25.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:35:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.954 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:35:25.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:35:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:35:28.100 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:28.663 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:35:28.708 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:28.709 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:35:29.751 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:35:31.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:35:31.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:35:31.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:35:31.671 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:31.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:35:31.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:35:31.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:35:31.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:35:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:35:31.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:35:31.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:35:31.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:35:31.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:35:31.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:35:31.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:35:32.723 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:32.724 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:35:34.106 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:35:34.930 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:35:35.194 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:35.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:35.907 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:35:36.611 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:35:38.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:35:38.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:35:38.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:35:38.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:35:38.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:35:38.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:35:38.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:35:38.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:35:38.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:35:38.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:35:38.818 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:35:38.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:35:38.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:35:38.998 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:39.928 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:39.928 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:35:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:35:41.765 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:35:42.187 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:42.897 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:35:43.030 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:43.030 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:35:44.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:35:44.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:35:44.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:35:44.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:35:44.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:35:44.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:35:44.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:35:44.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:35:44.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:35:44.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:35:45.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:35:45.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:35:45.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:35:45.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:35:46.289 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:46.977 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:46.977 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:35:47.069 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:35:47.671 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:35:49.586 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:35:49.892 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:49.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:35:50.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:35:50.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:35:50.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:35:50.088 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:35:50.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:35:50.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:35:50.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:35:50.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:35:50.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:35:50.247 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:35:50.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:35:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:35:50.604 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:50.604 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:35:53.103 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:35:53.138 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:35:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:54.100 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:54.100 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:35:55.849 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:35:56.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:35:56.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:35:56.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:35:56.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:35:56.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:35:56.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:35:56.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:35:56.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:35:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:35:56.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:35:56.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:35:56.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:35:56.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:35:56.649 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:35:57.870 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:35:57.871 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:35:59.204 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:35:59.558 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:36:00.643 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:36:01.595 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:36:01.596 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:36:01.973 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:36:02.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:02.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:02.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:02.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:02.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:02.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:02.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:02.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:02.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:02.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:02.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:02.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:36:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:36:04.428 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:36:05.083 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:36:05.083 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:36:05.524 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:36:06.073 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:36:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:36:08.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:08.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:08.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:08.706 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:36:08.706 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:36:08.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:08.745 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:08.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:08.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:08.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:08.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:08.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:08.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:08.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:36:08.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:36:09.074 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:36:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:36:11.703 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:36:12.059 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:36:12.060 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:36:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:36:14.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:14.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:14.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:14.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:14.592 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:14.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:14.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:14.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:14.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:14.726 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:14.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:14.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:14.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:36:14.856 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:36:15.078 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:36:15.724 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:36:15.725 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:36:17.509 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:36:17.963 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:36:18.081 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:36:19.159 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:36:20.357 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:20.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:20.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:20.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:20.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:20.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:20.512 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:20.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:20.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:20.592 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:20.618 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:20.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:20.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.648 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.648 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.648 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.648 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.648 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.648 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:36:20.964 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:36:21.834 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:36:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:36:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:36:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:36:21.834 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:36:22.683 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:36:23.240 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:36:23.811 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:36:25.646 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:36:25.646 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:36:25.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:36:25.647 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:36:25.647 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:36:26.318 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:36:26.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:26.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:26.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:26.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:26.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:26.555 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:26.581 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:26.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:26.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:26.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:26.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:36:26.928 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:36:28.998 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:36:29.322 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:36:29.711 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:36:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:36:32.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:32.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:32.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:32.170 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:32.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:32.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:32.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:32.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:32.308 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:36:32.308 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:36:32.309 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:36:32.309 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:36:32.309 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:36:32.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:32.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:32.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:32.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:32.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.396 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.396 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:36:32.396 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:36:33.131 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:36:33.345 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:36:35.285 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:36:35.555 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:36:35.555 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:36:35.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:36:35.555 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:36:35.555 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:36:36.078 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:36:36.359 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:36:38.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:38.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:38.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:38.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:38.579 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:38.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:38.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:38.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:38.685 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:38.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:36:38.889 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:36:39.327 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:36:40.031 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:36:41.338 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:36:41.669 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:36:43.139 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:36:43.995 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:36:44.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:44.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:44.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:44.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:44.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:44.514 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:36:44.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:44.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:44.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:44.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:44.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:44.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:44.694 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:44.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:36:44.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:36:46.743 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:36:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:36:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:36:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:36:46.744 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:36:47.399 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:36:47.513 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:36:48.101 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:36:50.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:50.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:50.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:50.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:50.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:50.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:50.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:50.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:50.277 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:36:50.294 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:50.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:50.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:50.399 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:36:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:36:51.121 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:36:51.255 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:36:53.278 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:36:53.591 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:36:54.141 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:36:54.448 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:36:55.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:36:55.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:36:55.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:36:55.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:36:56.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:36:56.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:36:56.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:36:56.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:36:56.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:36:56.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:36:56.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:36:56.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:36:56.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:36:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:36:57.114 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:36:57.161 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:36:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:36:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:36:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:36:57.162 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:36:57.866 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:36:58.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:37:00.085 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:37:01.292 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:01.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:01.979 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:37:02.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:37:02.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:37:02.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:37:02.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:37:02.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:37:02.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:37:02.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:37:02.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:37:02.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:37:02.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:37:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:37:02.568 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:37:02.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.572 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.572 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:37:02.805 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:37:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:05.308 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:05.308 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:37:05.442 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:37:06.100 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:37:08.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:37:08.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:37:08.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:37:08.259 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:08.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:37:08.293 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:37:08.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:37:08.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:37:08.371 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:37:08.398 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:37:08.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:37:08.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:37:08.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:37:08.478 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.478 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.478 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.478 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.478 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.478 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:37:08.868 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:08.869 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:37:08.896 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:37:11.261 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:37:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:12.441 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:12.441 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:37:12.704 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:37:13.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:37:13.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:37:13.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:37:13.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:37:14.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:37:14.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:37:14.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:37:14.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:37:14.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:37:14.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:37:14.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:37:14.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:37:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:37:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:37:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:15.627 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:37:15.877 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:15.878 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:37:16.943 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:37:18.949 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:19.209 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:37:19.650 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:19.650 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:37:20.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:37:20.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:37:20.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:37:20.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:37:20.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:37:20.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:37:20.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:37:20.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:37:20.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:37:20.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:37:20.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:37:20.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:37:20.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:37:20.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:37:22.061 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:22.191 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:37:22.716 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:22.717 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:37:23.286 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:37:25.799 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:37:26.484 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:26.484 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:37:27.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:37:27.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:37:27.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:37:27.175 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:37:27.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:37:27.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:37:27.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:37:27.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:37:27.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:37:27.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:37:27.412 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:37:27.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:37:27.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:37:27.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:37:28.989 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:29.084 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:37:29.716 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:29.717 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:37:30.220 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:37:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:33.142 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:37:33.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:37:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:37:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:37:33.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:37:33.543 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:33.544 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:37:33.564 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:37:33.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:37:33.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:37:33.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:37:33.676 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:37:33.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:37:33.728 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:37:33.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:37:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:37:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:37:35.928 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:35.999 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:37:36.474 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:37:36.655 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:36.655 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:37:39.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:37:39.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:37:39.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:37:39.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:37:39.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:37:39.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:37:39.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:37:39.734 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:37:39.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:37:39.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:37:39.810 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:39.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:37:39.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:37:39.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.842 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.842 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.842 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:37:39.842 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:37:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:37:40.671 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:40.672 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:37:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:42.980 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:37:43.154 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:37:43.629 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:43.629 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:37:46.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:37:46.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:37:46.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:37:46.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:37:46.396 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:37:46.423 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:37:46.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:37:46.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:37:46.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:37:46.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:37:46.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:37:46.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:37:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:37:46.774 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:47.116 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:37:47.819 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:47.820 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:37:49.471 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:37:49.874 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:49.982 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:37:50.690 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:50.691 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:37:53.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:37:53.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:37:53.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:37:53.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:37:53.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:37:53.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:37:53.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:37:53.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:37:53.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:37:53.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:37:53.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:37:53.685 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:54.229 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:37:54.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:37:54.246 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:37:54.285 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:54.286 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:37:56.702 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:37:56.896 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:37:57.203 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:37:57.265 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:37:57.265 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:38:00.181 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:38:00.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:00.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:00.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:00.368 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:00.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:00.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:00.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:00.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:00.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:00.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:00.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:00.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:00.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:38:00.824 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:38:01.672 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:38:01.673 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:38:02.955 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:38:03.500 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:38:03.691 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:38:04.570 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:38:04.570 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:38:06.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:06.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:06.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:06.897 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:06.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:06.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:06.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:07.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:07.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:07.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:07.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:07.119 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:38:07.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:07.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:38:07.887 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:38:08.517 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:38:08.517 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:38:09.887 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:38:10.095 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:38:10.578 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:38:11.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:38:11.462 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:38:13.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:13.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:13.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:13.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:13.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:13.814 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:38:13.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:13.857 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:13.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:13.924 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:13.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:14.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:14.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:38:14.554 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:38:15.264 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:38:15.264 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:38:16.480 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:38:16.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:38:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:38:18.634 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:38:18.634 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:38:19.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:19.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:19.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:19.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:19.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:19.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:20.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:20.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:20.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:20.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:20.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:20.122 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:38:20.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:20.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.169 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.169 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:38:20.170 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:38:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:38:22.289 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:38:22.290 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:38:22.972 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:38:23.241 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:38:25.374 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:38:26.152 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:38:26.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:26.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:26.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:26.355 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:26.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:26.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:26.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:26.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:26.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:26.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:26.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:26.568 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:26.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:38:26.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:38:27.141 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:38:28.657 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:38:28.657 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:38:28.657 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:38:28.657 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:38:28.657 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:38:29.331 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:38:29.349 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:38:30.030 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:38:32.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:32.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:32.767 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:38:32.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:32.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:32.840 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:32.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:32.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:32.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:32.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:32.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:33.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:38:33.466 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:38:34.173 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:38:35.871 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:38:35.875 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:38:36.594 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:38:37.010 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:38:39.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:39.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:39.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:39.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:39.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:39.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:39.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:39.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:39.463 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:39.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:39.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:39.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:38:39.954 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:38:39.954 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:38:39.954 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:38:39.954 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:38:39.954 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:38:40.695 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:38:41.145 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:38:42.307 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:38:42.770 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:38:42.770 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:38:42.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:38:42.771 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:38:42.771 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:38:43.536 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:38:43.871 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:38:44.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:44.863 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:44.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:44.909 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:44.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:44.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:45.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:45.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:45.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:45.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:45.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:45.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:38:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:38:46.664 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:38:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:38:47.361 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:38:47.889 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:38:49.765 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:38:50.069 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:38:50.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:50.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:50.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:50.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:50.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:50.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:50.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:50.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:50.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:50.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:50.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:50.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:38:50.967 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:38:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:38:53.542 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:38:53.575 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:38:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:38:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:38:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:38:53.576 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:38:54.252 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:38:55.818 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:38:56.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:38:56.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:38:56.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:38:56.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:38:56.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:38:56.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:38:56.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:38:56.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:38:56.512 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:38:56.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:38:56.557 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:38:56.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:38:56.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:38:56.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:38:56.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:38:57.355 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:38:59.667 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:38:59.784 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:39:00.148 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:39:00.440 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:39:02.904 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:02.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:02.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:02.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:03.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:03.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:03.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:03.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:03.106 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:03.119 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:39:03.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:03.149 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:39:03.149 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:39:03.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:39:03.149 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:39:03.149 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:39:03.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:03.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:39:03.948 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:39:06.218 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:39:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:39:07.249 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:07.249 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:39:09.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:09.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:09.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:09.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:09.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:09.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:09.485 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:09.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:09.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:09.566 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:09.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:09.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:09.621 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.621 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:39:09.806 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:09.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:39:10.716 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:10.717 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:39:12.196 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:39:13.446 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:14.384 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:14.385 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:39:14.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:14.924 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:14.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:14.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:15.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:15.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:15.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:15.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:15.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:15.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:15.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:15.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:39:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:39:16.672 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:17.288 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:17.289 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:39:18.050 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:39:19.464 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:20.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:20.359 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:39:20.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:20.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:20.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:20.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:20.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:20.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:20.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:20.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:20.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:20.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:21.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:21.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:21.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:39:21.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:39:22.721 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:39:23.333 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:23.334 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:39:23.926 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:39:25.806 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:39:25.939 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:26.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:26.462 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:39:27.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:27.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:27.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:27.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:27.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:27.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:27.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:27.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:27.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:27.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:27.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:27.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:27.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:39:27.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:39:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:29.993 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:29.993 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:39:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:39:30.415 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:39:32.695 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:39:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:33.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:33.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:33.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:33.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:33.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:33.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:33.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:33.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:33.300 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:33.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:33.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:33.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:39:33.565 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:33.565 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:39:36.105 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:39:36.259 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:36.260 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:39:37.238 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:37.239 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:39:38.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:38.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:39.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:39.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:39.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:39.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:39.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:39.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:39.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:39.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:39.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:39.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:39.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:39:39.511 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:39:39.851 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:40.457 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:40.457 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:39:41.958 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:39:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:39:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:44.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:44.216 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:39:44.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:44.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:44.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:44.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:44.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:44.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:44.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:44.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:44.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:44.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:44.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:44.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:44.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:39:44.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:39:45.948 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:39:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:47.234 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:47.235 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:39:47.716 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:39:49.271 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:39:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:50.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:50.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:50.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:50.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:50.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:50.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:50.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:50.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:50.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:50.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:50.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:50.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:39:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:39:51.106 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:51.106 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:39:52.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:39:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:53.520 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:39:54.447 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:54.448 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:39:56.302 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:39:56.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:39:56.515 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:39:56.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:39:56.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:39:56.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:39:56.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:39:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:39:56.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:39:56.693 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:39:56.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:39:56.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:39:56.777 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:39:56.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.781 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:39:56.782 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:39:57.706 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:39:58.313 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:39:58.314 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:39:59.003 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:39:59.441 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:40:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:40:02.243 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:40:02.243 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:40:02.599 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:02.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:02.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:02.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:02.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:02.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:02.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:02.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:02.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:02.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:02.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:02.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:40:02.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:40:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:40:04.777 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:40:05.361 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:40:05.361 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:40:05.738 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:40:06.177 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:40:08.099 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:40:09.118 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:40:09.119 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:40:09.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:09.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:09.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:09.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:09.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:09.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:09.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:09.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:09.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:09.418 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:09.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:09.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:09.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:40:09.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:40:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:40:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:40:12.126 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:40:12.126 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:40:12.261 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:40:12.971 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:40:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:40:15.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:15.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:15.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:15.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:15.574 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:15.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:15.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:15.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:15.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:15.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:15.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:15.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:15.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:40:15.820 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:40:15.820 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:40:18.211 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:40:18.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:40:18.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:40:18.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:40:20.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:20.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:20.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:20.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:21.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:21.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:21.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:21.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:21.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:21.147 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:40:21.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:21.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:21.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:21.204 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:40:21.850 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:40:21.851 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:40:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:40:24.036 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:40:24.528 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:40:24.529 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:40:26.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:26.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:26.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:26.718 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:26.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:26.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:26.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:26.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:26.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:26.879 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:40:26.880 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:40:26.880 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:40:26.880 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:40:26.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:26.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:26.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:26.942 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.942 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.942 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:40:26.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:40:27.191 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:40:27.659 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:40:29.919 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:40:29.919 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:40:29.920 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:40:29.920 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:40:29.920 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:40:29.946 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:40:30.133 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:40:30.646 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:40:33.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:33.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:33.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:33.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:33.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:33.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:33.581 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:33.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:33.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:33.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:33.723 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:40:33.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:33.735 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.736 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.736 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.736 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.736 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:40:33.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:40:34.229 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:40:34.563 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:40:36.745 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:40:36.834 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:40:37.054 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:40:37.401 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:40:40.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:40.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:40.495 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:40.523 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:40:40.523 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:40:40.523 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:40:40.524 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:40:40.524 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:40:40.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:40.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:40.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:40.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:40.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:40.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:40.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:40.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:40.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.832 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:40:40.832 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:40:41.153 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:40:41.259 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:40:43.612 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:40:43.647 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:40:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:40:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:40:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:40:43.648 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:40:44.136 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:40:44.255 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:40:47.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:47.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:47.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:47.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:47.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:47.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:47.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:47.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:47.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:47.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:47.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:47.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:40:47.615 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:40:48.206 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:40:48.458 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:40:50.041 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:40:50.528 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:40:50.808 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:40:51.144 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:40:53.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:53.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:53.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:53.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:53.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:53.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:53.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:53.301 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:53.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:53.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:53.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:53.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:40:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:40:54.715 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:40:54.715 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:40:54.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:40:54.715 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:40:54.715 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:40:55.274 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:40:55.323 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:40:56.119 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:40:57.869 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:40:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:40:57.869 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:40:57.869 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:40:57.917 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:40:58.483 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:40:58.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:40:58.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:40:58.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:40:58.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:40:59.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:40:59.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:40:59.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:40:59.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:40:59.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:40:59.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:40:59.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:40:59.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:40:59.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:40:59.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:41:01.297 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:41:01.298 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:41:02.057 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:41:02.244 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:41:04.228 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:41:04.472 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:41:05.266 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:41:07.207 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:41:07.814 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:08.300 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:08.301 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:41:09.931 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:41:10.256 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:11.068 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:11.069 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:41:13.217 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:13.267 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:41:14.014 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:14.014 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:41:14.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:41:14.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:41:14.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:41:14.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:41:14.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:41:14.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:41:14.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:41:15.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:41:15.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:41:15.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:41:15.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:41:15.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:41:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:41:15.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:41:16.179 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:41:16.323 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:16.967 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:16.967 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:41:17.830 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:41:20.166 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:20.209 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:41:20.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:41:20.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:41:20.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:41:20.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:41:20.860 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:41:20.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:41:20.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:41:20.927 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:20.928 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:41:20.967 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:41:21.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:41:21.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:41:21.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:41:21.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:41:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:41:21.108 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:41:23.106 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:41:23.226 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:23.789 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:41:23.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:23.840 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:41:26.705 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:41:26.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:41:26.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:41:26.780 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:41:26.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:41:26.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:41:26.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:41:26.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:41:26.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:41:26.978 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:27.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:41:27.029 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:41:27.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:41:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:41:27.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:27.840 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:41:29.843 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:29.993 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:41:30.472 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:30.472 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:41:32.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:41:32.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:41:32.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:41:32.652 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:32.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:41:32.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:41:32.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:41:32.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:41:32.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:41:32.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:41:32.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:41:32.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:41:32.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:41:32.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:41:33.250 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:33.250 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:41:35.279 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:35.636 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:41:35.858 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:35.859 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:41:37.245 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:41:38.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:41:38.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:41:38.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:41:38.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:41:38.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:41:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:41:38.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:41:38.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:41:38.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:41:38.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:41:38.605 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:38.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:41:38.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:41:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:41:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:41:39.402 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:39.403 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:41:39.943 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:41:41.577 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:41:41.741 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:42.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:42.259 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:41:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:41:44.990 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:45.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:41:45.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:41:45.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:41:45.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:41:45.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:41:45.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:41:45.294 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:41:45.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:41:45.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:41:45.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:41:45.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:41:45.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:41:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.429 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.429 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.429 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.429 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.429 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:41:45.656 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:45.657 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:41:46.536 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:41:48.094 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:41:48.190 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:48.723 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:48.724 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:41:50.229 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:41:51.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:41:51.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:41:51.515 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:41:51.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:41:51.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:41:51.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:41:51.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:41:51.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:41:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:51.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:41:51.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:41:51.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:41:51.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:41:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:41:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:41:52.448 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:52.448 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:41:53.133 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:41:54.632 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:41:54.837 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:55.563 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:55.563 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:41:56.705 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:41:58.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:41:58.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:41:58.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:41:58.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:41:58.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:41:58.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:41:58.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:41:58.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:41:58.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:41:58.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:41:58.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:41:58.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:41:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:41:58.555 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:41:59.381 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:41:59.382 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:41:59.557 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:42:01.180 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:42:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:42:02.658 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:42:02.659 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:42:03.281 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:42:04.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:42:04.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:42:04.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:42:04.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:42:04.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:42:04.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:42:04.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:42:04.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:42:04.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:42:04.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:42:04.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:42:04.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:42:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:42:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:42:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:42:05.997 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:42:05.998 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:42:06.104 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:42:07.091 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:42:09.601 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:42:09.602 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:42:10.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:42:10.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:42:10.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:42:10.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:42:10.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:42:10.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:42:10.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:42:10.244 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:42:10.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:42:10.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:42:10.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:42:10.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:42:10.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:42:10.414 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.414 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.414 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.414 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.414 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.414 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:42:10.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:42:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:42:12.859 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:42:12.859 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:42:12.935 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:42:13.425 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:42:15.625 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:42:16.278 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:42:16.278 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:42:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:42:16.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:42:16.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:42:16.936 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:42:16.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:42:16.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:42:17.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:42:17.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:42:17.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:42:17.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:42:17.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:42:17.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:42:17.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:42:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:42:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:42:18.896 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:42:19.507 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:42:19.507 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:42:19.832 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:42:20.308 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:42:22.390 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:42:23.285 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:42:23.285 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:42:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:42:23.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:42:23.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:42:23.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:42:23.802 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:42:23.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:42:23.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:42:23.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:42:23.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:42:23.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:42:23.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:42:24.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:42:24.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:42:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:42:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:42:25.856 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:42:26.481 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:42:26.502 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:42:27.036 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:42:29.708 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:42:30.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:42:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:42:30.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:42:30.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:42:30.339 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:42:30.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:42:30.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:42:30.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:42:30.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:42:30.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:42:30.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:42:30.612 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:42:30.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:42:30.704 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:42:30.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:42:30.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:42:32.825 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:42:32.833 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:42:32.833 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:42:32.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:42:32.834 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:42:32.834 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:42:33.368 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:42:33.497 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:42:36.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:42:36.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:42:36.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:42:36.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:42:36.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:42:36.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:42:36.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:42:36.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:42:36.553 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:42:36.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:42:36.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:42:36.621 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:42:36.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:42:36.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:42:36.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:42:36.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:42:37.751 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:42:39.447 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:42:39.807 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:42:39.941 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:42:40.609 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:42:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:42:43.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:42:43.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:42:43.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:42:43.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:42:43.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:42:43.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:42:43.581 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:42:43.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:42:43.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:42:43.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:42:43.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:42:43.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:42:43.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.716 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.716 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.716 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.716 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:42:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:42:43.942 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:42:43.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:42:43.942 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:42:43.942 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:42:44.628 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:42:45.927 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:42:46.449 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:42:46.646 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:42:46.647 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:42:46.647 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:42:46.647 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:42:47.492 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:42:49.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:42:49.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:42:49.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:42:49.875 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:42:49.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:42:49.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:42:49.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:42:49.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:42:50.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:42:50.029 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:42:50.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:42:50.093 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:42:50.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:42:50.232 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:42:50.256 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:42:51.143 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:42:52.894 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:42:53.237 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:42:53.390 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:42:54.036 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:42:55.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:42:55.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:42:55.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:42:55.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:42:55.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:42:55.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:42:55.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:42:55.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:42:55.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:42:56.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:42:56.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:42:56.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:42:56.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:42:56.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:42:57.316 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:42:57.316 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:42:57.316 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:42:57.317 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:42:57.710 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:42:57.997 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:42:58.722 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:43:00.399 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:43:00.476 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:43:00.477 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:43:00.477 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:43:00.477 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:43:00.477 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:43:01.023 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:43:01.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:01.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:01.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:01.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:01.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:01.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:01.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:01.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:02.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:02.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:02.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:02.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:43:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:43:03.942 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:43:04.586 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:43:04.973 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:43:07.098 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:07.739 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:07.739 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:43:07.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:07.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:07.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:07.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:07.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:07.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:07.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:07.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:07.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:08.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:08.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:08.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:08.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:43:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:43:09.748 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:10.334 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:10.335 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:43:10.916 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:43:12.697 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:13.326 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:13.326 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:43:13.699 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:13.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:13.745 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:13.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:13.793 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:13.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:13.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:13.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:13.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:13.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:13.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:14.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:43:14.743 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:43:15.864 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:16.506 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:16.507 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:43:16.987 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:43:17.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:43:19.471 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:20.133 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:20.134 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:43:20.512 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:20.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:20.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:20.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:20.609 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:20.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:20.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:20.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:20.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:20.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:20.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:20.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:20.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:43:20.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:43:21.275 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:43:22.876 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:23.425 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:23.425 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:43:23.510 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:43:24.034 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:43:26.026 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:26.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:26.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:26.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:26.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:26.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:26.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:26.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:26.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:26.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:26.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:26.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:26.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:26.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:43:26.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:43:27.000 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:27.000 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:43:28.710 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:43:29.769 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:43:29.779 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:30.356 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:30.356 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:43:31.375 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:43:32.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:32.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:32.893 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:32.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:32.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:32.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:32.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:33.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:33.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:33.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:33.106 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:33.108 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.108 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.108 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.108 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.109 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.109 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.109 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.109 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.109 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.109 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.109 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.110 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:43:33.371 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:34.269 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:34.269 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:43:35.747 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:43:35.928 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:43:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:37.393 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:37.394 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:43:38.506 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:43:38.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:38.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:38.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:38.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:38.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:38.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:38.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:38.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:38.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:38.897 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:38.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:38.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:43:38.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:43:40.541 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:41.032 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:41.032 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:43:41.839 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:43:41.880 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:43:43.821 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:44.380 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:44.381 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:43:44.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:44.771 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:43:44.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:44.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:44.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:44.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:44.897 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:44.924 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:44.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:44.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:45.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:45.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:45.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:45.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:43:45.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:43:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:47.808 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:47.808 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:43:47.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:43:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:43:50.523 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:51.022 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:43:51.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:51.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:51.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:51.155 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:51.156 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:43:51.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:51.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:51.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:51.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:51.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:51.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:51.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:51.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:51.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.409 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:43:51.409 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:43:53.775 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:43:54.290 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:54.514 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:43:54.810 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:54.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:43:56.394 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:43:56.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:43:56.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:43:56.988 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:43:57.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:43:57.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:43:57.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:43:57.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:43:57.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:43:57.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:43:57.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:43:57.178 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:43:57.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:43:57.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:43:57.254 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.254 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.254 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.255 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.255 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.255 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.255 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.255 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:43:57.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:43:58.111 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:43:58.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:44:00.299 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:44:00.394 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:44:00.426 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:44:01.338 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:44:01.338 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:44:03.023 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:44:03.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:03.423 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:03.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:03.459 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:44:03.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:03.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:03.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:03.555 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:03.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:03.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:03.635 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:03.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:03.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:03.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:44:03.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:44:04.233 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:44:04.233 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:44:06.699 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:44:06.837 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:44:06.872 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:44:07.938 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:44:07.939 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:44:09.496 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:44:09.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:09.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:09.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:09.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:09.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:09.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:10.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:10.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:10.075 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:10.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:10.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:10.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:44:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:44:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:44:11.898 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:44:11.899 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:44:12.879 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:44:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:44:15.008 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:44:15.729 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:44:15.729 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:44:15.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:15.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:15.883 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:15.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:15.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:15.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:16.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:16.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:16.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:16.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:16.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:16.140 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.140 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.140 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.140 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:44:16.157 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:44:18.260 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:44:18.816 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:44:18.931 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:44:18.931 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:44:20.420 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:44:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:21.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:21.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:21.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:21.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:21.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:21.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:21.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:21.848 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:44:21.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:21.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:21.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:21.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:21.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:44:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:44:22.508 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:44:22.508 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:44:23.396 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:44:24.770 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:44:24.956 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:44:25.938 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:44:25.939 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:44:26.699 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:44:28.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:28.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:28.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:28.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:28.599 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:28.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:28.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:28.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:28.704 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:28.730 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:28.757 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:28.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:28.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.786 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.786 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:44:28.786 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:44:29.086 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:44:29.529 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:44:29.755 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:44:31.384 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:44:32.229 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:44:32.447 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:44:32.885 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:44:34.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:34.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:34.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:34.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:34.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:34.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:34.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:34.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:34.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:34.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:34.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:44:34.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:44:35.670 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:44:35.772 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:44:35.772 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:44:35.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:44:35.772 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:44:35.773 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:44:36.429 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:44:37.167 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:44:39.485 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:44:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:44:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:44:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:44:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:44:40.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:40.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:40.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:40.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:40.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:40.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:40.603 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:44:40.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:40.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:40.672 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:40.705 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:40.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:40.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:40.768 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.768 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.769 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.769 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.769 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.769 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.769 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.769 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.769 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.770 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.770 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:44:40.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:44:42.424 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:44:42.820 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:44:43.199 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:44:43.598 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:44:46.300 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:46.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:46.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:46.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:46.423 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:46.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:46.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:46.540 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:44:46.540 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:44:46.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:44:46.541 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:44:46.541 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:44:46.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:46.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:46.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:46.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:46.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:44:46.698 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:44:47.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:44:49.568 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:44:49.568 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:44:49.568 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:44:49.568 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:44:49.655 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:44:49.840 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:44:50.198 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:44:52.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:52.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:52.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:52.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:52.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:53.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:53.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:53.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:53.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:53.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:53.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:53.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:53.216 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.219 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.219 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:44:53.303 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:44:53.336 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:44:54.516 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:44:56.071 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:44:56.469 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:44:56.643 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:44:57.992 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:44:59.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:44:59.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:44:59.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:44:59.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:44:59.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:44:59.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:44:59.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:44:59.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:44:59.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:44:59.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:44:59.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:44:59.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:44:59.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:44:59.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:45:00.377 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:45:01.014 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:45:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:45:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:45:01.015 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:45:01.517 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:45:02.358 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:45:03.106 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:45:03.621 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:45:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:45:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:45:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:45:03.621 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:45:04.893 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:45:05.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:45:05.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:45:05.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:45:05.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:45:05.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:45:05.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:45:05.857 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:45:05.887 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:45:05.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:45:05.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:45:05.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:45:05.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:45:05.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:45:05.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:45:05.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:45:05.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:45:05.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:45:05.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:45:05.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:45:05.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:45:05.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:45:06.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:45:06.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:45:06.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:45:07.637 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:45:07.719 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:45:08.429 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:45:08.993 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:45:10.597 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:45:10.807 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:11.537 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:11.537 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:45:12.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:45:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:45:12.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:45:12.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:45:12.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:45:12.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:45:12.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:45:12.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:45:12.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:45:12.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:45:12.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:45:12.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:45:12.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.434 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.434 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:45:12.434 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:45:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:15.005 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:15.005 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:45:15.233 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:45:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:45:17.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:45:17.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:45:17.980 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:45:18.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:45:18.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:45:18.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:45:18.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:45:18.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:45:18.119 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:45:18.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:45:18.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:45:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:18.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:45:18.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:45:18.218 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.219 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.220 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:45:18.983 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:18.984 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:45:21.168 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:45:21.479 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:45:22.606 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:22.607 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:45:23.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:45:23.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:45:23.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:45:23.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:45:23.866 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:45:23.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:45:23.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:45:23.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:45:23.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:45:23.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:45:24.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:45:24.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:45:24.053 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.053 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:45:24.618 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:45:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:25.827 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:25.828 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:45:26.706 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:45:28.641 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:28.828 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:45:29.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:29.345 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:45:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:45:30.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:45:30.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:45:30.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:45:30.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:45:30.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:45:30.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:45:30.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:45:30.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:45:30.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:45:30.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:45:30.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:45:30.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:45:30.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:45:31.747 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:45:31.804 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:32.398 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:32.398 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:45:33.211 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:45:35.339 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:45:35.679 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:36.605 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:36.605 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:45:36.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:45:36.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:45:36.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:45:36.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:45:36.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:45:36.797 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:45:36.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:45:36.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:45:36.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:45:36.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:45:36.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:45:36.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:45:36.958 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:45:36.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:45:38.154 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:45:38.715 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:39.477 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:39.477 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:45:39.651 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:45:41.655 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:45:42.281 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:42.993 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:42.993 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:45:43.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:45:43.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:45:43.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:45:43.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:45:43.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:45:43.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:45:43.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:45:43.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:45:43.485 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:45:43.512 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:45:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:45:43.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:45:43.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:45:43.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:45:44.581 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:45:45.300 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:45.981 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:45.982 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:45:46.495 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:45:47.688 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:45:48.857 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:49.351 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:49.352 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:45:49.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:45:49.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:45:50.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:45:50.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:45:50.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:45:50.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:45:50.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:45:50.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:45:50.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:45:50.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:45:50.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:45:50.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:45:50.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:45:50.483 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:45:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:52.797 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:52.797 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:45:53.191 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:45:53.571 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:45:55.577 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:56.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:45:56.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:45:56.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:45:56.196 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:56.197 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:45:56.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:45:56.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:45:56.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:45:56.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:45:56.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:45:56.368 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:45:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:45:56.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:45:56.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:45:56.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:45:56.753 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:45:58.983 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:45:59.204 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:45:59.699 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:45:59.700 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:46:00.643 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:46:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:46:03.012 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:46:03.012 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:46:03.449 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:46:05.543 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:46:06.095 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:46:06.096 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:46:06.708 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:46:08.373 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:46:08.964 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:46:08.964 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:46:09.401 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:46:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:46:11.877 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:46:12.119 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:46:12.119 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:46:12.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:46:12.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:46:12.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:46:12.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:46:12.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:46:12.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:46:12.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:46:12.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:46:12.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:46:12.423 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:46:12.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:46:12.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:46:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.482 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.482 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.482 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:46:12.482 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:46:14.495 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:46:14.590 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:46:15.179 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:46:15.236 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:46:15.237 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:46:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:46:18.725 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:46:19.095 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:46:19.095 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:46:19.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:46:19.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:46:19.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:46:19.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:46:19.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:46:19.308 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:46:19.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:46:19.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:46:19.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:46:19.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:46:19.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:46:19.489 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:46:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:46:19.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:46:21.498 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:46:21.547 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:46:22.151 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:46:22.151 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:46:22.172 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:46:25.164 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:46:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:46:25.827 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:46:25.827 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:46:25.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:46:25.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:46:25.893 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:46:25.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:46:25.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:46:25.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:46:26.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:46:26.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:46:26.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:46:26.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:46:26.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:46:26.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:46:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:46:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:46:28.258 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:46:28.296 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:46:28.992 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:46:29.033 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:46:29.034 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:46:31.809 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:46:31.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:46:31.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:46:31.982 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:46:32.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:46:32.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:46:32.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:46:32.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:46:32.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:46:32.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:46:32.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:46:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:46:32.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:46:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:46:32.471 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:46:33.317 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:46:34.608 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:46:35.142 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:46:35.488 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:46:36.953 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:46:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:46:38.555 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:46:38.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:46:38.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:46:38.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:46:38.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:46:38.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:46:38.618 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:46:38.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:46:38.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:46:38.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:46:38.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:46:38.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:46:38.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:46:38.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:46:40.007 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:46:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:46:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:46:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:46:40.008 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:46:40.579 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:46:40.599 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:46:41.413 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:46:43.948 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:46:43.948 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:46:43.948 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:46:43.949 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:46:44.047 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:46:44.796 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:46:45.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:46:45.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:46:45.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:46:45.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:46:45.175 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:46:45.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:46:45.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:46:45.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:46:45.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:46:45.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:46:45.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:46:45.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:46:45.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:46:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:46:47.039 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:46:47.154 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:46:47.782 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:46:47.998 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:46:50.854 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:46:51.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:46:51.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:46:51.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:46:51.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:46:51.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:46:51.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:46:51.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:46:51.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:46:51.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:46:51.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:46:51.379 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:46:51.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:46:51.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:46:51.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:46:51.567 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:46:53.962 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:46:53.962 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:46:53.962 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:46:53.962 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:46:54.026 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:46:54.380 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:46:54.492 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:46:57.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:46:57.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:46:57.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:46:57.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:46:57.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:46:57.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:46:57.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:46:57.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:46:57.482 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:46:57.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:46:57.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:46:57.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:46:57.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:46:57.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.585 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.585 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.585 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.585 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:46:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:46:58.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:47:00.526 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:47:00.671 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:47:00.678 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:47:01.203 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:47:04.203 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:47:04.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:47:04.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:47:04.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:47:04.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:47:04.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:47:04.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:47:04.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:47:04.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:47:04.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:47:04.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:47:04.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:47:04.554 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:47:04.555 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:47:04.555 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:47:04.555 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:47:04.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:47:04.568 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:47:04.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:47:05.342 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:47:06.863 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:47:07.430 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:47:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:47:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:47:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:47:07.431 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:47:07.546 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:47:08.121 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:47:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:47:11.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:47:11.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:47:11.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:47:11.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:47:11.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:47:11.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:47:11.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:47:11.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:47:11.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:47:11.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:47:11.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:47:11.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:47:11.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:47:11.786 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:47:12.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:47:13.181 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:47:13.718 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:47:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:15.915 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:15.916 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:47:16.702 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:47:16.728 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:47:16.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:47:16.798 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:47:16.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:47:16.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:47:16.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:47:16.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:47:16.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:47:16.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:47:16.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:47:17.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:47:17.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:47:17.040 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.040 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.040 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.040 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.040 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.040 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:47:17.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:47:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:19.299 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:19.300 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:47:19.426 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:47:19.941 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:47:22.187 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:22.949 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:22.949 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:47:22.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:47:22.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:47:23.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:47:23.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:47:23.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:47:23.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:47:23.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:47:23.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:47:23.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:47:23.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:47:23.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:47:23.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:47:23.307 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.308 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.308 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.308 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.308 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.308 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.308 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.309 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.309 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.309 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.309 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.309 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:47:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:47:25.315 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:25.858 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:25.859 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:47:26.190 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:47:26.506 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:47:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:29.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:47:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:47:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:47:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:47:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:47:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:47:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:47:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:47:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:47:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:47:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:47:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:47:29.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:47:29.732 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:29.733 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:47:30.732 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:47:32.273 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:32.406 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:47:32.904 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:32.905 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:47:33.683 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:47:35.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:47:35.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:47:35.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:47:35.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:47:35.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:47:35.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:47:35.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:47:35.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:47:35.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:47:35.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:47:35.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:47:35.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:47:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:47:35.932 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:36.988 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:36.988 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:47:37.744 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:47:38.785 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:47:39.325 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:40.081 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:40.081 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:47:40.508 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:47:41.398 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:47:41.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:47:41.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:47:41.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:47:41.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:47:41.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:47:41.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:47:41.579 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:47:41.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:47:41.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:47:41.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:47:41.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:47:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:47:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:47:43.204 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:43.774 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:47:43.993 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:43.994 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:47:44.783 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:47:46.458 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:47:46.657 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:47.513 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:47.513 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:47:47.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:47:47.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:47:47.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:47:47.723 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:47:47.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:47:47.777 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:47:47.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:47:47.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:47:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:47:47.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:47:47.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:47:47.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:47:47.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:47:47.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:47:50.417 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:47:50.501 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:51.027 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:47:51.398 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:51.399 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:47:53.169 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:47:53.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:47:53.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:47:53.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:47:53.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:47:53.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:47:53.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:47:53.730 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:47:53.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:47:53.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:47:53.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:47:53.818 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:53.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:47:53.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:47:53.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:47:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:47:54.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:54.579 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:47:56.707 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:47:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:47:57.216 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:47:57.756 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:47:57.756 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:47:59.318 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:47:59.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:00.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:00.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:00.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:00.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:00.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:00.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:00.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:00.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:00.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:00.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:00.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:00.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:48:00.304 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:01.724 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:01.724 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:48:02.373 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:48:03.378 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:48:04.028 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:04.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:04.765 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:48:05.089 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:48:05.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:05.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:06.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:06.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:06.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:06.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:06.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:06.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:06.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:06.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:06.246 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:06.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:48:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:48:07.785 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:08.502 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:08.503 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:48:08.710 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:48:09.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:48:11.367 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:48:11.369 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:11.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:11.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:11.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:11.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:11.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:11.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:11.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:11.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:11.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:11.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:11.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:48:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:48:12.195 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:12.196 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:48:14.680 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:48:14.820 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:15.426 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:48:15.637 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:15.638 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:48:17.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:17.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:17.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:17.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:17.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:17.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:17.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:17.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:17.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:17.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:17.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:18.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:18.026 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.026 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.028 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.028 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.028 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:48:18.083 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:48:18.248 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:19.123 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:19.123 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:48:20.860 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:48:21.491 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:48:21.550 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:22.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:22.766 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:48:23.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:23.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:23.635 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:23.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:23.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:23.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:23.745 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:23.773 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:23.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:23.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:23.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:23.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:48:23.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:48:24.373 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:48:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:26.438 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:26.438 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:48:26.732 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:48:27.779 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:48:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:29.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:29.962 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:29.981 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:29.981 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:48:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:30.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:30.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:30.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:30.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:30.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:30.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:30.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:30.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:48:30.636 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:48:32.528 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:32.973 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:48:33.215 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:33.216 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:48:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:48:35.718 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:35.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:35.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:35.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:35.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:35.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:35.887 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:35.909 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:48:35.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:35.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:35.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:36.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:36.029 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:36.031 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:48:36.731 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:48:36.731 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:48:37.296 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:48:38.906 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:48:39.144 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:48:39.806 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:48:41.448 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:48:42.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:42.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:42.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:42.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:42.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:42.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:42.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:42.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:42.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:42.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:42.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:42.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:48:42.661 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:48:42.661 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:48:42.661 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:48:42.661 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:48:42.662 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:48:43.394 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:48:44.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:48:45.244 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:48:45.586 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:48:45.586 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:48:45.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:48:45.587 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:48:45.587 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:48:46.509 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:48:47.714 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:48:49.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:49.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:49.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:49.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:49.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:49.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:49.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:49.365 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:48:49.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:49.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:49.438 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:49.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:49.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:49.496 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.496 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.496 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:48:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:48:50.003 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:48:50.664 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:48:52.422 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:48:52.672 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:48:53.602 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:48:53.625 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:48:55.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:48:55.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:48:55.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:48:55.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:48:55.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:48:55.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:48:55.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:48:55.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:48:55.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:48:55.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:48:56.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:48:56.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:48:56.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.051 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.051 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:48:56.651 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:48:56.672 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:48:56.672 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:48:56.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:48:56.673 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:48:56.673 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:48:57.206 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:48:58.658 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:48:59.519 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:48:59.519 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:48:59.519 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:48:59.519 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:48:59.717 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:49:00.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:49:01.673 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:01.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:01.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:01.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:01.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:01.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:01.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:01.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:01.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:01.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:01.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:01.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:49:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:49:02.916 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:49:03.080 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:49:03.847 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:49:04.687 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:49:06.708 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:49:07.007 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:49:07.948 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:49:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:08.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:08.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:08.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:08.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:08.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:08.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:08.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:08.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:08.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:08.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:49:08.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:49:09.382 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:49:10.259 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:49:10.259 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:49:10.259 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:49:10.259 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:49:11.123 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:49:11.466 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:49:12.118 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:49:14.084 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:49:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:49:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:49:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:49:14.085 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:49:14.703 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:49:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:14.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:14.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:14.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:14.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:14.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:14.957 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:49:14.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:14.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:15.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:15.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:15.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:15.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:15.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:49:15.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:49:17.344 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:49:17.893 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:49:18.159 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:49:18.481 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:49:20.811 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:21.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:21.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:21.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:21.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:21.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:21.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:21.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:21.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:21.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:21.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:49:21.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:21.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:21.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.373 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:49:21.482 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:21.483 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:49:23.929 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:49:24.353 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:49:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:25.586 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:25.587 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:49:26.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:26.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:26.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:26.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:26.564 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:26.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:26.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:26.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:26.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:26.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:26.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:26.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:26.758 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:49:26.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:49:27.284 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:49:27.793 INFO:ceph.mgr.y.smithi071.stdout:*** Caught signal (Segmentation fault) ** 2019-12-22T22:49:27.793 INFO:ceph.mgr.y.smithi071.stdout: in thread 7fc0b21e9700 thread_name:msgr-worker-2 2019-12-22T22:49:27.793 INFO:ceph.mgr.y.smithi071.stdout: ceph version 15.0.0-8807-g99b509f (99b509ffd4dd354919b08b38ba83b998fbfdc107) octopus (dev) 2019-12-22T22:49:27.794 INFO:ceph.mgr.y.smithi071.stdout: 1: (()+0x12d80) [0x7fc0b6b62d80] 2019-12-22T22:49:27.794 INFO:ceph.mgr.y.smithi071.stdout: 2: (CephxSessionHandler::_calc_signature(Message*, unsigned long*)+0x349) [0x7fc0b8513469] 2019-12-22T22:49:27.794 INFO:ceph.mgr.y.smithi071.stdout: 3: (CephxSessionHandler::sign_message(Message*)+0x60) [0x7fc0b85135e0] 2019-12-22T22:49:27.794 INFO:ceph.mgr.y.smithi071.stdout: 4: (ProtocolV1::write_message(Message*, ceph::buffer::v14_2_0::list&, bool)+0x9d5) [0x7fc0b875aa35] 2019-12-22T22:49:27.794 INFO:ceph.mgr.y.smithi071.stdout: 5: (ProtocolV1::write_event()+0x318) [0x7fc0b875afe8] 2019-12-22T22:49:27.794 INFO:ceph.mgr.y.smithi071.stdout: 6: (AsyncConnection::handle_write()+0x47) [0x7fc0b873fc67] 2019-12-22T22:49:27.794 INFO:ceph.mgr.y.smithi071.stdout: 7: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0x1546) [0x7fc0b879b0c6] 2019-12-22T22:49:27.795 INFO:ceph.mgr.y.smithi071.stdout: 8: (()+0x59694c) [0x7fc0b87a094c] 2019-12-22T22:49:27.795 INFO:ceph.mgr.y.smithi071.stdout: 9: (()+0xc2a33) [0x7fc0b600fa33] 2019-12-22T22:49:27.795 INFO:ceph.mgr.y.smithi071.stdout: 10: (()+0x82de) [0x7fc0b6b582de] 2019-12-22T22:49:27.795 INFO:ceph.mgr.y.smithi071.stdout: 11: (clone()+0x43) [0x7fc0b56eba63] 2019-12-22T22:49:27.795 INFO:ceph.mgr.y.smithi071.stdout:2019-12-22T22:49:27.553+0000 7fc0b21e9700 -1 *** Caught signal (Segmentation fault) ** 2019-12-22T22:49:27.795 INFO:ceph.mgr.y.smithi071.stdout: in thread 7fc0b21e9700 thread_name:msgr-worker-2 2019-12-22T22:49:27.795 INFO:ceph.mgr.y.smithi071.stdout: 2019-12-22T22:49:27.796 INFO:ceph.mgr.y.smithi071.stdout: ceph version 15.0.0-8807-g99b509f (99b509ffd4dd354919b08b38ba83b998fbfdc107) octopus (dev) 2019-12-22T22:49:27.796 INFO:ceph.mgr.y.smithi071.stdout: 1: (()+0x12d80) [0x7fc0b6b62d80] 2019-12-22T22:49:27.796 INFO:ceph.mgr.y.smithi071.stdout: 2: (CephxSessionHandler::_calc_signature(Message*, unsigned long*)+0x349) [0x7fc0b8513469] 2019-12-22T22:49:27.796 INFO:ceph.mgr.y.smithi071.stdout: 3: (CephxSessionHandler::sign_message(Message*)+0x60) [0x7fc0b85135e0] 2019-12-22T22:49:27.796 INFO:ceph.mgr.y.smithi071.stdout: 4: (ProtocolV1::write_message(Message*, ceph::buffer::v14_2_0::list&, bool)+0x9d5) [0x7fc0b875aa35] 2019-12-22T22:49:27.796 INFO:ceph.mgr.y.smithi071.stdout: 5: (ProtocolV1::write_event()+0x318) [0x7fc0b875afe8] 2019-12-22T22:49:27.796 INFO:ceph.mgr.y.smithi071.stdout: 6: (AsyncConnection::handle_write()+0x47) [0x7fc0b873fc67] 2019-12-22T22:49:27.797 INFO:ceph.mgr.y.smithi071.stdout: 7: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0x1546) [0x7fc0b879b0c6] 2019-12-22T22:49:27.797 INFO:ceph.mgr.y.smithi071.stdout: 8: (()+0x59694c) [0x7fc0b87a094c] 2019-12-22T22:49:27.797 INFO:ceph.mgr.y.smithi071.stdout: 9: (()+0xc2a33) [0x7fc0b600fa33] 2019-12-22T22:49:27.797 INFO:ceph.mgr.y.smithi071.stdout: 10: (()+0x82de) [0x7fc0b6b582de] 2019-12-22T22:49:27.797 INFO:ceph.mgr.y.smithi071.stdout: 11: (clone()+0x43) [0x7fc0b56eba63] 2019-12-22T22:49:27.797 INFO:ceph.mgr.y.smithi071.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-22T22:49:27.797 INFO:ceph.mgr.y.smithi071.stdout: 2019-12-22T22:49:27.798 INFO:ceph.mgr.y.smithi071.stdout: 0> 2019-12-22T22:49:27.553+0000 7fc0b21e9700 -1 *** Caught signal (Segmentation fault) ** 2019-12-22T22:49:27.798 INFO:ceph.mgr.y.smithi071.stdout: in thread 7fc0b21e9700 thread_name:msgr-worker-2 2019-12-22T22:49:27.798 INFO:ceph.mgr.y.smithi071.stdout: 2019-12-22T22:49:27.798 INFO:ceph.mgr.y.smithi071.stdout: ceph version 15.0.0-8807-g99b509f (99b509ffd4dd354919b08b38ba83b998fbfdc107) octopus (dev) 2019-12-22T22:49:27.798 INFO:ceph.mgr.y.smithi071.stdout: 1: (()+0x12d80) [0x7fc0b6b62d80] 2019-12-22T22:49:27.798 INFO:ceph.mgr.y.smithi071.stdout: 2: (CephxSessionHandler::_calc_signature(Message*, unsigned long*)+0x349) [0x7fc0b8513469] 2019-12-22T22:49:27.798 INFO:ceph.mgr.y.smithi071.stdout: 3: (CephxSessionHandler::sign_message(Message*)+0x60) [0x7fc0b85135e0] 2019-12-22T22:49:27.798 INFO:ceph.mgr.y.smithi071.stdout: 4: (ProtocolV1::write_message(Message*, ceph::buffer::v14_2_0::list&, bool)+0x9d5) [0x7fc0b875aa35] 2019-12-22T22:49:27.799 INFO:ceph.mgr.y.smithi071.stdout: 5: (ProtocolV1::write_event()+0x318) [0x7fc0b875afe8] 2019-12-22T22:49:27.799 INFO:ceph.mgr.y.smithi071.stdout: 6: (AsyncConnection::handle_write()+0x47) [0x7fc0b873fc67] 2019-12-22T22:49:27.799 INFO:ceph.mgr.y.smithi071.stdout: 7: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0x1546) [0x7fc0b879b0c6] 2019-12-22T22:49:27.799 INFO:ceph.mgr.y.smithi071.stdout: 8: (()+0x59694c) [0x7fc0b87a094c] 2019-12-22T22:49:27.799 INFO:ceph.mgr.y.smithi071.stdout: 9: (()+0xc2a33) [0x7fc0b600fa33] 2019-12-22T22:49:27.799 INFO:ceph.mgr.y.smithi071.stdout: 10: (()+0x82de) [0x7fc0b6b582de] 2019-12-22T22:49:27.799 INFO:ceph.mgr.y.smithi071.stdout: 11: (clone()+0x43) [0x7fc0b56eba63] 2019-12-22T22:49:27.800 INFO:ceph.mgr.y.smithi071.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-22T22:49:27.800 INFO:ceph.mgr.y.smithi071.stdout: 2019-12-22T22:49:27.800 INFO:ceph.mgr.y.smithi071.stdout: 0> 2019-12-22T22:49:27.553+0000 7fc0b21e9700 -1 *** Caught signal (Segmentation fault) ** 2019-12-22T22:49:27.800 INFO:ceph.mgr.y.smithi071.stdout: in thread 7fc0b21e9700 thread_name:msgr-worker-2 2019-12-22T22:49:27.801 INFO:ceph.mgr.y.smithi071.stdout: 2019-12-22T22:49:27.801 INFO:ceph.mgr.y.smithi071.stdout: ceph version 15.0.0-8807-g99b509f (99b509ffd4dd354919b08b38ba83b998fbfdc107) octopus (dev) 2019-12-22T22:49:27.801 INFO:ceph.mgr.y.smithi071.stdout: 1: (()+0x12d80) [0x7fc0b6b62d80] 2019-12-22T22:49:27.801 INFO:ceph.mgr.y.smithi071.stdout: 2: (CephxSessionHandler::_calc_signature(Message*, unsigned long*)+0x349) [0x7fc0b8513469] 2019-12-22T22:49:27.801 INFO:ceph.mgr.y.smithi071.stdout: 3: (CephxSessionHandler::sign_message(Message*)+0x60) [0x7fc0b85135e0] 2019-12-22T22:49:27.801 INFO:ceph.mgr.y.smithi071.stdout: 4: (ProtocolV1::write_message(Message*, ceph::buffer::v14_2_0::list&, bool)+0x9d5) [0x7fc0b875aa35] 2019-12-22T22:49:27.802 INFO:ceph.mgr.y.smithi071.stdout: 5: (ProtocolV1::write_event()+0x318) [0x7fc0b875afe8] 2019-12-22T22:49:27.802 INFO:ceph.mgr.y.smithi071.stdout: 6: (AsyncConnection::handle_write()+0x47) [0x7fc0b873fc67] 2019-12-22T22:49:27.802 INFO:ceph.mgr.y.smithi071.stdout: 7: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0x1546) [0x7fc0b879b0c6] 2019-12-22T22:49:27.802 INFO:ceph.mgr.y.smithi071.stdout: 8: (()+0x59694c) [0x7fc0b87a094c] 2019-12-22T22:49:27.802 INFO:ceph.mgr.y.smithi071.stdout: 9: (()+0xc2a33) [0x7fc0b600fa33] 2019-12-22T22:49:27.803 INFO:ceph.mgr.y.smithi071.stdout: 10: (()+0x82de) [0x7fc0b6b582de] 2019-12-22T22:49:27.804 INFO:ceph.mgr.y.smithi071.stdout: 11: (clone()+0x43) [0x7fc0b56eba63] 2019-12-22T22:49:27.804 INFO:ceph.mgr.y.smithi071.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-22T22:49:27.804 INFO:ceph.mgr.y.smithi071.stdout: 2019-12-22T22:49:27.804 INFO:ceph.mgr.y.smithi071.stdout:reraise_fatal: default handler for signal 11 didn't terminate the process? 2019-12-22T22:49:28.107 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:29.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:29.162 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:49:29.570 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:49:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:49:31.988 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:32.759 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:32.759 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:49:33.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:33.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:33.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:33.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:33.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:33.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:33.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:33.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:33.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:33.454 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.454 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.454 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.454 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:49:33.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:49:34.458 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:49:35.124 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:35.792 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:35.793 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:49:36.305 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:49:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:49:39.010 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:39.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:39.685 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:49:40.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:40.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:40.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:40.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:40.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:40.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:40.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:40.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:40.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:40.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:40.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:40.676 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:49:40.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:40.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:49:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:49:42.271 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:43.167 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:43.167 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:49:43.718 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:49:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:49:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:46.368 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:46.408 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:46.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:46.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:46.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:46.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:46.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:46.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:46.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:46.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:46.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:46.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:49:46.883 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:46.884 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:49:47.067 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:49:49.310 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:49:50.137 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:50.483 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:49:51.291 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:51.291 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:49:52.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:52.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:52.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:52.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:52.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:52.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:52.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:52.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:52.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:52.264 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:52.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:52.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:52.322 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.323 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.323 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.323 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.323 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.325 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:49:52.325 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:49:53.561 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:49:53.735 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:54.485 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:54.485 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:49:55.198 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:49:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:49:57.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:49:57.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:49:57.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:49:57.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:49:57.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:49:57.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:49:57.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:49:57.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:49:57.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:49:57.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:49:57.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:49:58.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:49:58.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:49:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:49:59.060 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:49:59.061 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:50:00.186 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:50:00.778 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:50:01.369 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:02.665 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:02.665 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:50:04.117 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:50:04.264 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:50:04.264 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:50:04.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:50:04.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:50:04.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:50:04.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:50:04.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:50:04.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:50:04.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:50:04.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:50:04.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:50:04.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:50:04.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:50:04.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:50:05.605 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:06.198 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:06.199 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:50:06.838 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:50:07.308 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:50:09.686 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:10.485 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:50:10.651 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:10.652 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:50:10.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:50:10.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:50:10.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:50:10.883 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:50:10.909 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:50:10.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:50:10.970 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:50:11.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:50:11.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:50:11.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:50:11.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:50:11.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:50:11.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:50:11.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:50:13.187 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:50:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:13.859 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:50:13.945 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:13.946 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:50:17.147 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:17.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:50:17.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:50:17.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:50:17.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:50:17.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:50:17.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:50:17.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:50:17.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:50:17.482 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:50:17.492 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:50:17.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:50:17.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:50:17.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:50:17.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.564 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:50:17.796 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:17.796 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:50:20.343 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:50:20.384 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:20.647 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:50:21.160 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:21.161 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:50:23.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:50:23.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:50:23.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:50:23.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:50:23.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:50:23.988 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:50:24.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:50:24.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:50:24.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:50:24.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:50:24.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:50:24.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:50:24.156 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.157 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.157 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.157 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.157 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.157 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:50:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:24.531 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:50:25.422 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:25.423 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:50:27.091 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:50:27.421 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:27.592 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:50:28.195 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:28.195 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:50:30.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:50:30.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:50:30.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:50:30.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:50:30.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:50:30.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:50:30.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:50:30.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:50:30.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:50:30.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:50:30.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:50:30.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:50:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:50:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:50:31.500 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:50:31.734 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:32.521 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:32.522 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:50:33.427 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:50:34.141 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:50:34.788 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:35.669 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:35.670 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:50:37.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:50:37.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:50:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:50:37.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:50:37.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:50:37.748 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:50:37.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:50:37.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:50:37.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:50:37.852 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:50:37.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:50:37.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:50:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:50:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:50:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:50:38.883 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:38.883 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:50:40.521 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:50:41.065 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:41.341 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:50:41.794 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:41.795 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:50:44.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:50:44.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:50:44.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:50:44.264 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:50:44.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:50:44.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:50:44.342 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:50:44.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:50:44.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:50:44.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:50:44.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:50:44.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:50:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:50:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:50:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:50:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:50:45.771 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:50:45.771 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:50:47.227 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:50:48.074 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:50:48.257 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:50:48.779 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:50:51.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:50:51.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:50:51.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:50:51.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:50:51.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:50:51.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:50:51.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:50:51.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:50:51.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:50:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:50:51.371 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:50:51.398 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:50:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:50:51.988 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:50:51.988 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:50:51.988 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:50:51.988 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:50:51.989 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:50:52.513 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:50:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:50:54.077 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:50:54.911 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:50:54.911 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:50:54.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:50:54.911 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:50:54.912 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:50:55.059 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:50:55.650 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:50:57.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:50:57.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:50:58.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:50:58.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:50:58.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:50:58.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:50:58.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:50:58.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:50:58.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:50:58.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:50:58.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:50:58.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:50:58.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:50:58.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:50:59.478 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:50:59.523 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:51:00.258 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:51:01.176 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:51:02.479 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:51:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:51:03.832 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:51:04.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:51:04.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:51:04.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:51:04.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:51:04.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:51:04.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:51:04.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:51:04.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:51:04.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:51:04.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:51:04.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:51:04.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:51:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:51:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:51:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:51:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:51:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:51:04.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:51:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:51:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:51:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:51:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:51:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:51:05.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:51:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:51:06.669 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:51:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:51:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:51:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:51:06.669 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:51:07.554 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:51:08.083 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:51:09.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:51:10.026 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:51:10.026 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:51:10.027 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:51:10.027 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:51:10.848 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:51:12.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:51:12.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:51:12.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:51:12.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:51:12.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:51:12.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:51:12.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:51:12.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:51:12.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:51:12.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:51:12.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:51:12.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:51:12.434 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:51:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:51:14.080 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:51:14.705 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:51:15.344 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:51:15.645 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:51:18.086 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:51:18.926 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:51:18.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:51:18.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:51:19.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:51:19.041 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:51:19.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:51:19.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:51:19.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:51:19.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:51:19.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:51:19.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:51:19.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:51:19.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:51:19.264 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.264 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:51:19.532 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:51:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:51:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:51:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:51:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:51:22.035 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:51:22.268 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:51:22.571 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:51:25.123 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:51:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:51:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:51:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:51:25.124 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:51:25.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:51:25.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:51:25.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:51:25.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:51:25.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:51:25.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:51:25.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:51:25.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:51:25.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:51:25.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:51:25.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:51:25.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:51:25.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:51:25.917 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:51:26.539 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:51:28.395 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:51:28.692 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:51:28.995 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:51:29.374 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:51:31.438 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:51:31.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:51:31.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:51:31.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:51:31.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:51:31.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:51:31.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:51:31.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:51:31.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:51:31.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:51:31.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:51:31.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:51:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:51:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:51:32.545 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:51:33.243 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:51:33.243 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:51:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:51:34.444 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:51:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:51:36.873 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:51:36.874 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:51:37.206 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:51:37.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:51:37.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:51:37.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:51:37.568 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:51:37.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:51:37.635 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:51:37.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:51:37.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:51:37.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:51:37.728 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:51:37.780 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:51:37.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:51:37.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.842 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:51:37.842 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:51:39.688 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:51:40.449 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:51:40.450 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:51:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:51:40.924 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:51:43.071 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:51:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:51:43.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:51:43.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:51:43.482 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:51:43.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:51:43.555 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:51:43.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:51:43.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:51:43.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:51:43.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:51:43.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:51:43.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:51:43.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:51:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:51:43.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:51:44.073 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:51:44.073 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:51:46.543 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:51:46.551 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:51:47.106 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:51:47.762 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:51:47.762 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:51:49.212 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:51:49.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:51:49.748 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:51:49.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:51:49.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:51:49.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:51:49.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:51:49.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:51:49.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:51:49.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:51:49.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:51:49.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:51:50.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:51:50.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:51:50.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:51:51.409 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:51:52.110 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:51:52.110 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:51:52.552 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:51:52.781 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:51:54.853 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:51:55.170 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:51:55.508 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:51:55.509 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:51:55.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:51:55.581 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:51:55.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:51:55.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:51:55.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:51:55.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:51:55.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:51:55.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:51:55.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:51:55.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:51:55.818 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:51:55.844 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:51:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:51:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:51:58.242 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:51:58.604 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:51:58.826 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:51:58.895 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:51:58.896 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:52:01.270 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:52:01.634 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:01.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:52:01.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:52:01.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:52:01.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:52:01.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:52:01.911 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:52:01.942 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:52:01.975 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:52:02.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:52:02.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:52:02.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:52:02.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:52:02.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:52:02.632 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:02.633 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:52:04.911 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:52:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:05.560 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:52:05.826 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:05.827 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:52:07.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:52:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:52:07.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:52:07.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:52:07.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:52:07.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:52:07.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:52:07.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:52:07.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:52:07.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:52:07.780 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:52:07.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:52:07.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:52:07.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:52:08.306 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:52:08.901 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:09.603 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:09.604 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:52:10.510 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:52:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:52:12.212 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:13.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:13.019 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:52:13.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:52:13.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:52:13.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:52:13.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:52:13.730 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:52:13.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:52:13.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:52:13.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:52:13.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:52:13.867 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:52:13.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:52:13.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:52:13.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:52:13.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:52:14.508 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:52:15.406 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:16.268 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:16.269 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:52:16.900 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:52:17.577 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:52:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:19.950 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:19.950 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:52:19.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:52:20.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:52:20.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:52:20.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:52:20.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:52:20.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:52:20.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:52:20.170 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:52:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:52:20.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:52:20.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:52:20.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:52:20.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:52:20.620 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:52:22.525 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:23.005 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:52:23.015 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:23.015 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:52:24.617 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:52:26.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:52:26.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:52:26.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:52:26.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:52:26.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:52:26.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:52:26.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:52:26.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:52:26.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:52:26.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:52:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:26.357 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:52:26.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:52:26.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:52:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:52:27.159 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:27.159 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:52:27.626 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:52:29.329 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:52:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:29.946 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:29.947 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:52:31.568 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:52:32.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:52:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:52:32.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:52:32.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:52:32.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:52:32.975 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:52:33.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:52:33.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:52:33.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:52:33.062 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:33.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:52:33.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:52:33.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:52:33.162 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.162 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.162 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:52:33.891 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:33.892 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:52:34.560 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:52:36.080 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:52:36.366 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:37.088 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:37.089 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:52:38.607 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:52:39.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:52:39.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:52:39.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:52:39.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:52:39.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:52:39.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:52:40.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:52:40.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:52:40.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:52:40.086 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:40.093 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:52:40.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:52:40.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:52:40.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:52:40.920 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:40.921 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:52:41.393 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:52:43.099 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:52:43.526 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:44.321 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:44.321 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:52:44.627 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:52:47.217 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:47.656 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:52:47.874 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:47.875 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:52:50.424 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:51.056 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:51.057 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:52:53.124 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:52:53.598 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:52:53.599 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:52:55.692 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:52:56.243 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:52:56.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:52:56.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:52:56.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:52:56.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:52:56.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:52:56.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:52:56.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:52:56.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:52:56.899 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:52:56.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:52:56.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:52:57.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:52:57.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:52:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:52:58.740 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:52:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:52:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:52:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:52:58.741 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:52:59.341 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:52:59.819 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:53:00.617 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:53:02.229 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:53:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:53:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:53:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:53:02.230 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:53:02.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:02.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:02.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:02.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:02.858 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:53:02.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:02.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:02.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:02.954 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:02.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:03.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:03.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:03.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:03.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:53:03.556 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:53:05.809 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:53:05.864 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:53:06.569 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:53:06.589 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:53:08.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:08.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:08.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:08.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:09.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:09.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:09.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:09.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:09.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:09.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:09.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:09.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:53:09.310 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:53:09.844 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:53:09.844 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:53:09.845 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:53:09.845 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:53:09.845 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:53:10.479 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:53:11.977 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:53:12.912 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:53:13.035 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:53:13.036 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:53:13.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:53:13.036 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:53:13.036 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:53:14.175 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:53:14.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:14.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:14.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:14.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:14.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:15.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:15.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:15.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:15.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:15.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:15.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:15.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:53:15.797 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:53:16.653 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:53:17.368 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:53:18.070 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:53:18.813 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:53:20.607 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:53:21.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:21.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:21.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:21.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:21.325 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:53:21.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:21.398 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:21.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:21.531 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.531 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.531 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:53:21.895 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:53:24.186 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:53:24.186 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:53:24.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:53:24.186 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:53:24.186 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:53:24.362 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:53:24.901 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:53:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:53:27.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:27.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:27.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:27.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:27.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:27.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:27.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:27.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:27.676 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:27.696 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:53:27.704 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:27.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:27.745 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.745 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:53:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:53:28.546 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:53:28.660 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:53:30.703 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:53:31.428 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:53:31.618 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:53:32.228 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:53:34.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:34.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:34.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:34.247 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:34.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:34.301 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:34.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:34.355 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:34.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:34.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:34.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:53:34.880 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:53:34.976 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:53:34.977 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:53:34.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:53:34.977 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:53:34.977 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:53:35.520 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:53:37.027 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:53:38.148 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:53:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:53:39.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:53:39.346 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:53:40.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:40.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:40.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:40.226 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:40.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:40.316 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:40.342 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:40.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:40.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:40.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:40.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:40.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.452 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.452 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.452 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:53:40.452 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:53:41.639 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:53:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:53:42.588 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:53:42.589 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:53:43.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:53:44.700 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:53:45.716 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:53:46.401 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:53:46.402 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:53:46.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:46.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:46.875 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:46.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:46.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:46.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:47.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:47.047 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:47.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:47.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:47.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:53:47.910 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:53:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:53:49.998 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:53:49.998 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:53:50.003 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:53:50.608 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:53:52.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:52.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:52.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:52.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:52.954 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:53:52.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:53.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:53.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:53.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:53.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:53.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:53.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:53.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:53.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:53:53.591 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:53:53.592 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:53:53.693 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:53:56.010 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:53:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:53:56.609 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:53:57.397 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:53:57.398 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:53:58.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:53:58.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:53:58.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:53:58.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:53:58.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:53:58.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:53:58.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:53:59.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:53:59.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:53:59.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:53:59.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:53:59.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:53:59.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:53:59.782 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:54:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:00.908 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:00.909 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:54:01.662 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:54:02.889 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:54:03.644 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:04.359 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:04.360 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:54:04.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:54:05.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:54:05.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:54:05.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:54:05.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:54:05.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:54:05.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:54:05.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:54:05.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:54:05.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:54:05.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:54:05.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:54:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:54:05.822 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:54:06.787 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:07.554 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:07.554 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:54:08.402 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:54:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:54:10.353 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:11.311 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:11.311 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:54:11.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:54:11.728 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:54:11.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:54:11.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:54:11.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:54:11.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:54:11.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:54:11.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:54:11.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:54:11.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:54:11.976 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:54:11.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:54:12.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:54:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:54:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:54:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:15.139 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:54:15.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:15.190 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:54:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:54:18.010 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:18.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:54:18.593 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:54:18.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:54:18.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:54:18.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:54:18.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:54:18.713 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:18.713 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:54:18.723 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:54:18.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:54:18.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:54:18.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:54:18.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:54:18.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:54:18.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:54:18.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:54:18.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:54:21.644 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:54:21.714 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:21.793 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:54:22.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:22.734 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:54:24.491 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:54:25.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:54:25.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:54:25.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:54:25.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:54:25.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:54:25.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:54:25.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:54:25.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:54:25.245 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:25.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:54:25.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:54:25.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:54:25.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:54:25.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:54:25.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:54:26.183 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:26.184 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:54:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:54:28.450 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:54:28.817 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:29.682 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:29.682 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:54:30.404 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:54:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:54:30.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:54:30.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:54:31.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:54:31.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:54:31.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:54:31.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:54:31.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:54:31.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:54:31.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:54:31.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:54:31.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:54:31.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:54:31.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:54:32.940 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:33.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:33.680 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:54:34.125 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:54:34.234 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:54:36.490 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:37.186 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:54:37.188 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:37.188 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:54:37.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:54:37.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:54:37.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:54:37.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:54:37.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:54:37.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:54:37.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:54:37.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:54:37.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:54:37.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:54:37.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:54:37.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:54:37.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:54:37.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:54:40.689 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:54:40.874 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:40.874 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:54:43.383 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:54:43.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:54:43.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:54:43.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:54:43.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:54:43.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:54:43.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:54:43.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:54:43.745 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:54:43.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:54:43.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:54:43.824 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:43.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:54:43.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:54:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:54:43.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:54:44.789 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:44.790 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:54:46.992 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:54:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:54:48.091 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:48.091 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:54:50.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:54:50.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:54:50.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:54:50.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:54:50.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:54:50.255 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:54:50.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:54:50.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:54:50.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:54:50.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:54:50.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:54:50.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:54:50.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.424 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.424 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.424 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:54:50.676 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:54:50.959 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:51.721 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:51.722 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:54:53.044 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:54:54.241 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:54:55.030 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:55.859 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:55.860 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:54:56.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:54:56.264 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:54:56.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:54:56.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:54:56.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:54:56.369 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:54:56.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:54:56.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:54:56.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:54:56.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:54:56.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:54:56.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:54:56.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:54:57.326 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:54:58.874 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:54:59.405 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:54:59.406 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:54:59.511 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:55:00.656 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:55:02.298 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:55:03.000 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:55:03.000 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:55:03.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:55:03.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:55:03.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:55:03.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:55:03.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:55:03.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:55:03.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:55:03.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:55:03.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:55:03.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:55:03.316 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:55:03.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:55:03.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:55:03.553 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:55:05.639 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:55:05.639 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:55:05.639 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:55:05.639 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:55:06.134 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:55:06.276 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:55:07.660 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:55:08.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:55:09.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:55:09.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:55:09.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:55:09.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:55:09.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:55:09.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:55:09.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:55:09.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:55:09.304 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:55:09.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:55:09.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:55:09.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:55:09.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:55:10.130 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:55:10.546 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:55:12.334 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:55:12.745 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:55:13.556 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:55:14.244 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:55:16.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:55:16.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:55:16.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:55:16.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:55:16.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:55:16.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:55:16.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:55:16.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:55:16.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:55:16.351 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:55:16.351 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:55:16.351 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:55:16.351 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:55:16.361 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:55:16.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:55:16.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:55:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:55:16.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:55:17.094 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:55:17.110 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:55:19.332 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:55:19.807 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:55:19.807 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:55:19.807 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:55:19.807 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:55:19.807 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:55:20.651 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:55:20.816 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:55:22.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:55:22.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:55:22.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:55:23.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:55:23.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:55:23.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:55:23.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:55:23.115 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:55:23.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:55:23.170 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:55:23.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:55:23.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:55:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:55:23.388 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:55:23.498 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:55:24.435 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:55:25.846 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:55:26.711 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:55:28.318 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:55:28.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:55:28.975 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:55:28.976 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:55:29.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:55:29.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:55:29.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:55:29.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:55:29.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:55:29.139 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:55:29.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:55:29.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:55:29.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:55:29.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:55:29.331 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.331 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.331 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.331 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.331 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.331 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:55:29.981 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:55:31.742 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:55:31.743 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:55:31.743 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:55:31.743 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:55:31.743 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:55:32.135 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:55:32.285 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:55:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:55:35.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:55:35.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:55:35.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:55:35.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:55:35.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:55:35.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:55:35.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:55:35.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:55:35.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:55:35.468 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:55:35.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:55:35.495 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:55:35.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:55:35.523 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:55:35.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:55:36.013 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:55:36.318 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:55:38.513 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:55:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:55:39.046 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:55:40.249 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:55:41.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:55:41.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:55:41.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:55:41.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:55:41.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:55:41.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:55:41.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:55:41.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:55:41.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:55:41.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:55:41.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:55:41.316 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:55:41.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.318 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.318 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.318 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.318 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.318 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.318 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.318 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:55:41.875 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:55:43.065 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:55:43.065 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:55:43.065 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:55:43.065 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:55:43.066 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:55:44.070 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:55:44.285 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:55:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:55:46.956 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:55:46.957 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:55:46.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:55:46.957 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:55:46.957 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:55:47.622 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:55:47.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:55:47.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:55:47.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:55:47.733 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:55:47.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:55:47.797 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:55:47.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:55:47.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:55:47.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:55:47.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:55:47.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:55:47.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:55:47.972 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.972 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.972 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.972 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:55:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:55:48.511 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:55:49.931 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:55:50.736 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:55:50.736 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:55:50.757 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:55:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:55:53.501 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:55:54.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:55:54.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:55:54.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:55:54.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:55:54.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:55:54.150 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:55:54.150 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:55:54.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:55:54.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:55:54.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:55:54.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:55:54.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:55:54.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:55:54.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:55:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:55:54.766 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:55:57.030 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:55:57.178 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:55:57.821 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:55:57.821 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:55:58.707 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:56:00.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:00.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:00.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:00.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:00.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:00.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:00.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:00.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:00.632 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:00.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:00.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:00.694 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:00.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:00.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:56:00.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:56:01.452 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:01.453 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:56:01.884 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:56:03.598 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:56:04.022 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:05.237 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:05.238 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:56:05.759 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:56:06.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:06.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:06.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:06.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:06.228 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:06.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:06.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:06.308 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:06.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:06.361 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:06.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:06.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:06.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:56:06.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:56:08.026 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:08.643 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:08.643 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:56:08.677 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:56:09.183 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:56:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:12.629 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:12.629 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:56:12.688 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:56:12.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:12.924 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:12.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:12.970 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:12.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:13.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:13.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:13.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:13.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:13.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:13.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:13.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:56:13.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:56:15.066 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:15.332 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:56:15.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:15.685 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:56:16.007 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:56:18.804 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:56:18.947 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:19.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:19.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:19.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:19.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:19.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:19.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:19.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:19.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:19.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:19.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:19.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:19.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:19.421 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.421 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.421 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.421 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.421 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.421 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:56:19.788 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:19.789 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:56:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:22.137 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:56:22.352 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:56:22.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:22.684 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:56:25.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:25.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:25.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:25.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:25.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:25.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:25.856 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:56:25.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:25.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:25.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:25.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:26.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:26.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:56:26.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:56:27.199 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:27.199 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:56:28.789 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:56:29.196 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:56:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:30.081 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:30.082 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:56:32.703 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:56:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:32.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:32.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:32.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:32.954 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:32.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:33.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:33.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:33.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:33.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:33.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:33.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:33.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:56:33.493 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:34.235 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:34.235 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:56:35.425 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:56:35.853 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:56:36.255 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:37.149 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:37.149 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:56:38.991 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:56:39.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:39.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:39.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:39.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:39.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:39.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:39.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:39.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:39.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:39.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:39.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:39.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:39.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:56:39.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:56:40.805 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:41.419 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:41.419 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:56:42.144 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:56:42.399 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:56:44.580 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:45.463 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:45.463 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:56:45.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:45.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:45.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:46.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:46.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:46.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:46.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:46.130 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:46.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:46.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:46.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:46.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:56:46.717 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:56:48.234 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:48.884 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:48.885 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:56:49.191 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:56:49.680 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:56:51.719 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:52.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:52.640 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:52.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:52.643 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:56:52.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:52.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:52.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:52.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:52.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:52.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:52.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:52.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:52.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:52.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:56:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:56:53.714 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:56:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:55.660 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:56:56.046 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:56:56.047 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:56:56.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:56:58.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:56:58.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:56:59.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:56:59.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:56:59.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:56:59.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:56:59.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:56:59.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:56:59.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:56:59.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:56:59.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:56:59.276 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:56:59.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:56:59.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.290 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:56:59.952 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:57:00.066 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:57:00.066 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:57:02.295 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:57:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:57:02.733 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:57:03.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:57:03.211 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:57:06.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:57:06.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:57:06.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:57:06.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:57:06.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:57:06.170 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:57:06.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:57:06.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:57:06.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:57:06.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:57:06.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:57:06.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:57:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:57:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:57:06.732 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:57:07.549 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:57:07.550 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:57:09.207 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:57:09.663 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:57:09.718 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:57:10.590 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:57:10.590 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:57:13.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:57:13.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:57:13.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:57:13.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:57:13.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:57:13.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:57:13.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:57:13.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:57:13.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:57:13.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:57:13.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:57:13.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:57:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:57:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:57:14.436 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:57:14.437 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:57:15.996 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:57:16.522 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:57:16.522 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:57:16.522 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:57:16.522 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:57:16.809 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:57:17.245 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:57:20.319 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:57:20.319 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:57:20.319 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:57:20.319 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:57:20.320 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:57:20.714 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:57:20.991 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:57:23.360 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:57:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:57:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:57:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:57:23.361 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:57:23.506 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:57:24.003 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:57:26.591 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:57:26.591 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:57:26.591 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:57:26.592 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:57:26.771 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:57:27.206 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:57:29.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:57:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:57:29.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:57:29.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:57:29.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:57:29.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:57:29.385 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:57:29.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:57:29.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:57:29.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:57:29.512 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:57:29.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:57:29.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:57:29.568 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:57:29.609 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:57:30.006 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:57:32.621 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:57:32.728 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:57:32.740 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:57:33.939 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:57:35.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:57:35.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:57:35.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:57:35.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:57:35.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:57:35.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:57:35.481 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:57:35.522 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:57:35.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:57:35.592 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:57:35.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:57:35.673 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:57:35.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.677 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.677 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.677 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:57:35.717 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:57:36.693 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:57:36.694 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:57:36.694 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:57:36.694 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:57:37.412 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:57:38.425 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:57:38.844 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:57:40.798 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:57:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:57:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:57:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:57:40.798 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:57:41.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:57:41.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:57:41.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:57:41.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:57:41.535 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:57:41.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:57:41.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:57:41.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:57:41.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:57:41.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:57:41.728 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:57:41.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:57:41.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:57:41.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:57:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:57:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:57:44.483 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:57:44.838 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:57:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:57:45.063 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:57:47.601 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:57:47.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:57:47.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:57:47.734 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:57:47.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:57:47.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:57:47.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:57:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:57:47.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:57:47.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:57:47.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:57:47.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:57:47.967 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:57:47.967 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:57:47.967 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:57:47.967 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:57:47.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:57:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:57:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:57:49.009 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T22:57:50.743 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:57:51.167 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:57:51.851 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:57:51.851 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:57:51.851 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:57:51.851 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:57:51.851 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:57:52.588 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T22:57:53.437 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:57:53.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:57:53.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:57:53.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:57:53.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:57:53.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:57:53.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:57:53.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:57:53.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:57:53.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:57:53.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:57:54.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:57:54.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:57:54.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:57:54.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:57:55.870 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:57:56.541 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T22:57:56.736 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:57:56.904 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:57:59.432 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:57:59.478 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:57:59.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:57:59.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:57:59.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:57:59.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:57:59.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:57:59.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:57:59.870 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:57:59.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:57:59.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:57:59.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:00.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:00.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:00.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:58:00.372 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:00.372 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T22:58:02.863 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:02.870 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:58:03.281 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:58:03.515 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:03.515 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T22:58:06.069 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:58:06.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:58:06.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:58:06.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:58:06.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:58:06.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:58:06.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:58:06.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:58:06.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:58:06.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:58:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:06.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:06.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:06.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:58:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:58:07.149 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:07.150 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T22:58:09.556 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:58:09.735 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:10.280 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:58:10.493 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:10.493 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T22:58:12.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:58:12.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:58:12.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:58:12.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:58:12.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:58:12.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:58:12.866 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:58:12.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:58:12.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:58:12.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:13.029 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:58:13.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:13.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:58:13.307 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:14.220 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:14.221 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T22:58:15.685 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:58:16.759 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:58:17.345 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:18.202 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:18.202 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T22:58:18.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:58:18.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:58:18.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:58:18.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:58:18.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:58:18.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:58:19.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:58:19.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:58:19.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:58:19.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:19.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:19.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:19.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:58:19.610 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:58:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:21.923 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:21.923 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T22:58:22.095 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:58:22.881 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:58:24.853 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:25.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:58:25.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:58:25.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:58:25.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:58:25.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:58:25.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:58:25.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:58:25.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:58:25.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:58:25.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:25.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:58:25.653 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:25.654 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T22:58:26.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:58:28.073 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:58:28.258 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:58:29.139 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:29.139 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T22:58:31.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:58:31.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:58:31.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:58:31.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:58:31.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:58:31.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:58:31.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:58:31.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:58:31.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:58:31.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:31.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:31.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:31.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:58:31.780 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:58:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:32.827 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:32.827 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T22:58:34.272 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:58:35.660 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:35.765 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:58:36.640 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:36.641 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T22:58:37.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:58:37.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:58:37.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:58:37.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:58:37.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:58:37.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:58:37.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:58:37.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:58:37.718 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:58:37.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:37.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:37.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:37.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:58:37.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:58:38.944 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:58:39.270 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:40.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:40.138 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T22:58:40.791 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:58:41.764 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:58:43.412 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:44.182 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:44.183 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T22:58:44.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:58:44.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:58:44.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:58:44.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:58:44.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:58:44.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:58:44.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:58:44.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:58:44.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:58:44.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:44.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:44.499 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:44.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:58:44.718 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:58:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:47.235 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:58:47.996 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:47.996 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T22:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:58:50.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:58:50.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:58:50.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:58:50.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:58:50.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:58:50.673 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:58:50.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:58:50.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:58:50.753 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:50.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:58:50.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:50.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:50.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:50.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:58:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:58:51.582 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:51.583 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T22:58:51.740 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:58:53.749 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:58:54.198 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:55.018 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:55.019 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T22:58:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:58:57.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:58:57.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:58:57.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:58:57.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:58:57.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:58:57.766 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:58:57.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:58:57.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:58:57.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:58:57.868 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:58:57.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:58:57.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:58:57.924 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:58:57.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:58:57.936 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:58:58.596 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:58:58.689 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:58:58.690 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T22:59:00.857 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:59:01.457 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:59:01.779 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:59:02.106 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:59:02.107 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T22:59:04.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:59:04.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:59:04.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:59:04.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:59:04.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:59:04.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:59:04.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:59:04.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:59:04.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:59:04.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:59:04.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:59:04.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:59:04.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:59:04.702 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:59:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:59:05.642 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:59:05.643 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T22:59:07.096 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:59:08.570 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:59:08.841 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:59:09.488 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:59:09.488 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T22:59:10.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:59:10.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:59:10.467 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:59:10.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:59:10.515 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:59:10.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:59:10.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:59:10.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:59:10.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:59:10.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:59:10.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:59:10.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:59:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:59:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:59:11.746 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:59:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:59:12.517 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:59:12.518 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T22:59:13.301 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:59:15.916 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:59:16.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:59:16.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:59:16.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:59:16.300 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:59:16.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:59:16.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:59:16.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:59:16.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:59:16.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:59:16.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:59:16.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:59:16.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:59:16.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.536 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:59:16.697 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:59:16.698 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T22:59:18.897 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:59:19.132 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:59:19.506 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:59:19.507 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T22:59:21.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:59:21.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:59:21.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:59:21.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:59:21.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:59:21.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:59:21.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:59:21.986 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T22:59:22.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:59:22.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:59:22.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:59:22.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:59:22.130 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:59:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:59:22.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T22:59:22.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T22:59:25.042 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:59:25.078 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:59:25.715 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T22:59:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:59:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:59:28.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:59:28.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:59:28.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:59:28.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:59:28.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:59:28.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:59:28.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:59:28.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:59:28.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:59:28.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:59:28.420 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:59:28.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:59:28.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.435 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.439 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:59:28.517 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:59:28.518 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:59:28.518 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T22:59:28.518 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T22:59:28.518 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:59:29.580 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T22:59:31.299 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:59:31.865 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:59:32.020 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:59:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:59:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:59:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:59:32.021 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:59:33.226 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T22:59:33.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:59:34.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:59:34.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:59:34.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:59:34.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:59:34.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:59:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:59:34.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:59:34.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:59:34.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:59:34.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:59:34.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:59:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:59:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:59:35.084 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T22:59:35.844 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:59:36.630 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T22:59:37.240 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:59:38.904 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T22:59:39.873 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:59:40.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:59:40.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:59:40.410 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T22:59:40.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:59:40.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:59:40.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:59:40.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:59:40.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:59:40.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:59:40.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:59:40.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:59:40.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:59:40.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:59:40.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.670 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.670 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.670 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.670 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:59:40.670 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:59:41.922 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T22:59:42.562 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:59:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:59:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:59:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:59:42.563 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:59:43.275 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T22:59:43.438 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:59:45.925 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T22:59:46.609 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:59:46.609 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:59:46.610 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:59:46.610 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:59:47.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:59:47.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:59:47.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:59:47.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:59:47.242 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T22:59:47.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:59:47.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:59:47.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:59:47.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:59:47.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:59:47.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:59:47.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:59:47.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:59:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T22:59:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T22:59:48.738 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T22:59:50.006 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T22:59:50.218 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T22:59:50.752 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T22:59:51.810 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T22:59:53.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T22:59:53.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T22:59:53.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T22:59:53.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T22:59:53.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T22:59:53.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T22:59:53.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T22:59:53.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T22:59:53.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T22:59:53.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T22:59:53.864 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:59:53.865 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T22:59:53.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T22:59:53.865 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T22:59:53.865 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:59:53.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T22:59:53.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T22:59:53.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T22:59:53.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T22:59:54.675 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T22:59:54.824 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T22:59:56.847 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T22:59:57.272 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T22:59:57.272 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T22:59:57.272 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T22:59:57.272 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T22:59:57.810 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T22:59:58.078 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:00:00.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:00:00.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:00:00.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:00:00.399 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:00:00.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:00:00.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:00:00.481 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:00:00.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:00:00.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:00:00.574 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:00:00.602 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:00:00.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:00:00.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:00:00.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:00:00.777 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:00:01.775 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:00:03.443 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:00:04.835 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:00:05.015 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:00:06.064 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:00:07.694 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:00:08.299 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:08.996 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:08.997 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:00:10.807 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:00:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:11.931 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:11.932 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:00:13.464 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:00:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:14.663 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:14.663 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:00:16.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:00:16.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:00:16.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:00:16.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:00:16.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:00:16.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:00:16.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:00:16.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:00:16.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:00:16.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:00:16.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:00:16.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:00:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.800 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.800 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.800 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:00:16.810 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:00:16.834 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:17.994 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:17.995 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:00:19.769 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:00:19.990 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:00:20.140 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:21.088 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:21.218 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:00:23.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:00:23.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:00:23.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:00:23.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:00:23.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:00:23.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:00:23.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:00:23.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:00:23.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:00:23.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:00:23.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:00:23.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:00:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:00:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:00:24.653 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:24.829 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:00:25.310 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:25.310 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:00:26.225 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:00:27.753 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:00:27.937 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:28.661 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:28.662 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:00:29.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:00:29.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:00:29.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:00:29.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:00:29.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:00:29.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:00:29.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:00:29.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:00:29.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:00:29.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:00:29.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:00:29.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:00:29.568 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:00:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:00:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:31.878 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:00:32.465 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:00:32.517 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:32.517 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:00:34.723 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:00:34.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:00:35.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:00:35.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:00:35.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:00:35.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:00:35.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:00:35.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:00:35.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:00:35.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:00:35.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:00:35.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:00:35.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:00:35.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:00:35.319 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:36.519 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:36.520 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:00:37.843 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:00:38.185 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:00:39.197 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:39.945 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:39.945 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:00:40.714 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:00:41.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:00:41.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:00:41.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:00:41.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:00:41.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:00:41.485 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:00:41.512 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:00:41.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:00:41.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:00:41.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:00:41.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:00:41.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:00:41.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.648 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:00:41.648 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:00:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:44.004 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:44.005 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:00:44.514 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:00:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:00:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:47.780 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:47.780 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:00:48.126 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:00:50.200 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:50.838 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:50.838 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:00:51.843 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:00:53.190 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:53.839 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:53.839 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:00:54.697 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:00:56.376 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:00:57.140 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:00:57.141 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:00:57.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:00:57.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:00:57.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:00:57.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:00:57.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:00:57.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:00:57.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:00:57.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:00:57.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:00:57.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:00:57.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:00:57.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:00:57.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:00:57.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:00:58.310 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:00:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:01:00.353 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:01:00.354 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:01:01.012 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:01:01.285 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:01:03.208 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:01:04.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:01:04.392 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:01:04.392 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:01:04.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:01:04.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:01:04.485 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:01:04.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:01:04.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:01:04.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:01:04.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:01:04.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:01:04.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:01:04.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:01:04.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:01:04.726 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.726 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.726 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.726 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.726 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:01:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:01:06.678 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:01:07.281 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:01:07.281 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:01:07.615 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:01:09.939 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:01:10.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:01:10.579 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:01:10.579 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:01:10.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:01:10.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:01:10.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:01:10.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:01:10.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:01:10.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:01:10.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:01:10.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:01:10.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:01:10.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:01:10.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:01:10.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.869 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.869 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:01:10.869 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:01:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:01:13.232 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:01:13.233 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:01:13.615 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:01:15.701 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:01:15.840 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:01:16.320 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:01:16.320 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:01:16.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:01:16.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:01:16.533 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:01:16.566 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:01:16.592 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:01:16.618 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:01:16.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:01:16.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:01:16.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:01:16.723 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:01:16.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:01:16.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:01:16.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.786 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.786 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.786 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:01:16.786 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:01:18.778 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:01:18.971 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:01:19.489 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:01:19.820 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:01:19.821 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:01:22.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:01:22.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:01:22.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:01:22.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:01:22.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:01:22.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:01:22.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:01:22.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:01:22.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:01:22.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:01:22.843 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:01:22.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:01:22.893 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:01:22.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:01:22.910 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:01:24.125 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:01:24.126 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:01:25.742 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:01:26.107 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:01:26.132 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:01:26.893 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:01:26.894 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:01:29.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:01:29.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:01:29.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:01:29.892 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:01:29.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:01:29.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:01:29.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:01:29.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:01:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:01:30.041 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:01:30.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:01:30.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:01:30.097 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:01:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:01:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:01:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:01:30.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:01:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:01:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:01:31.074 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:01:32.573 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:01:32.990 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:01:32.990 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:01:32.991 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:01:32.991 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:01:32.991 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:01:33.303 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:01:33.867 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:01:36.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:01:36.635 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:01:36.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:01:36.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:01:36.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:01:36.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:01:36.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:01:36.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:01:36.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:01:36.838 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:01:36.848 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:01:36.870 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:01:36.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:01:36.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:01:36.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:01:36.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:01:37.869 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:01:39.980 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:01:40.110 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:01:40.111 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:01:40.756 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:01:43.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:01:43.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:01:43.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:01:43.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:01:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:01:43.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:01:43.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:01:43.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:01:43.780 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:01:43.818 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:01:43.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:01:43.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:01:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:01:43.989 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:01:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:01:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:01:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:01:43.989 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:01:44.915 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:01:44.967 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:01:46.799 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:01:47.237 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:01:47.238 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:01:47.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:01:47.238 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:01:47.238 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:01:47.452 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:01:48.108 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:01:50.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:01:50.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:01:50.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:01:50.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:01:50.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:01:50.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:01:50.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:01:50.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:01:50.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:01:50.798 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:01:50.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:01:50.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:01:50.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.855 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:01:50.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:01:51.827 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:01:51.864 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:01:52.609 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:01:53.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:01:54.779 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:01:55.310 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:01:56.500 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:01:57.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:01:57.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:01:57.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:01:57.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:01:57.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:01:57.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:01:57.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:01:57.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:01:57.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:01:57.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:01:57.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:01:57.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:01:57.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:01:57.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:01:58.876 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:01:59.163 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:01:59.163 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:01:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:01:59.164 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:01:59.164 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:01:59.942 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:02:00.064 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:02:01.545 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:02:02.823 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:02:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:02:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:02:02.824 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:02:03.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:02:03.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:02:03.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:02:03.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:02:03.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:02:03.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:02:03.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:02:03.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:02:03.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:02:03.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:02:03.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:02:03.342 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:02:03.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.346 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.346 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.346 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.346 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.346 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.346 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:02:03.666 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:02:06.226 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:02:06.244 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:02:06.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:02:09.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:02:09.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:02:09.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:02:09.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:02:09.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:02:09.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:02:09.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:02:09.401 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:02:09.401 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:02:09.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:02:09.401 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:02:09.401 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:02:09.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:02:09.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:02:09.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:02:09.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:02:09.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:02:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:02:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:02:10.140 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:02:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:12.336 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:02:12.846 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:12.846 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:02:15.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:02:15.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:02:15.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:02:15.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:02:15.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:02:15.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:02:15.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:02:15.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:02:15.240 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:15.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:02:15.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:02:15.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:02:15.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:02:15.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:02:15.870 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:02:15.963 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:15.964 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:02:18.118 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:02:18.238 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:18.668 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:02:18.958 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:18.959 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:02:21.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:02:21.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:02:21.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:02:21.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:02:21.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:02:21.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:02:21.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:02:21.883 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:02:21.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:02:21.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:02:21.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:02:21.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:02:21.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:02:21.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:02:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:22.893 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:02:22.938 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:22.939 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:02:24.767 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:02:25.169 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:25.418 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:02:25.998 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:25.998 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:02:27.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:02:27.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:02:28.010 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:02:28.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:02:28.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:02:28.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:02:28.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:02:28.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:02:28.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:02:28.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:02:28.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:02:28.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:02:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:02:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:02:29.612 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:29.968 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:02:30.265 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:30.265 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:02:31.300 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:02:32.644 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:02:32.973 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:33.697 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:33.698 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:02:34.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:02:34.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:02:34.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:02:35.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:02:35.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:02:35.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:02:35.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:02:35.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:02:35.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:02:35.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:02:35.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:02:35.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:02:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:02:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:02:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:36.886 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:02:37.504 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:37.505 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:02:38.158 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:02:39.684 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:02:40.285 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:41.171 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:41.171 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:02:41.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:02:41.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:02:41.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:02:41.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:02:41.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:02:41.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:02:41.482 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:02:41.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:02:41.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:02:41.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:02:41.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:02:41.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:02:41.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:02:41.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:02:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:02:44.388 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:02:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:45.154 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:45.154 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:02:45.913 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:02:48.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:02:48.301 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:02:48.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:02:48.327 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:48.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:02:48.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:02:48.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:02:48.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:02:48.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:02:48.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:02:48.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:02:48.579 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:02:48.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:02:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.617 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:02:48.618 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:02:49.082 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:49.083 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:02:50.259 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:02:51.501 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:02:51.610 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:52.398 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:52.399 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:02:53.168 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:02:54.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:02:54.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:02:54.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:02:54.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:02:54.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:02:54.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:02:54.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:02:54.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:02:54.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:02:54.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:02:54.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:02:54.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:02:54.758 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:02:54.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:02:55.353 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:56.222 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:56.223 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:02:57.663 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:02:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:02:58.542 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:02:59.299 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:02:59.300 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:03:00.878 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:03:01.355 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:03:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:03:01.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:03:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:03:01.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:03:01.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:03:01.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:03:01.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:03:01.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:03:01.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:03:01.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:03:01.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:03:01.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:03:01.743 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:03:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:03.368 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:03.369 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:03:04.342 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:03:04.857 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:03:05.772 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:06.620 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:06.621 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:03:07.265 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:03:07.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:03:07.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:03:07.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:03:07.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:03:07.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:03:07.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:03:07.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:03:07.685 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:03:07.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:03:07.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:03:07.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:03:07.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:03:07.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:03:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:03:09.747 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:10.406 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:10.407 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:03:10.900 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:03:11.062 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:03:13.296 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:13.649 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:03:13.931 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:13.931 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:03:14.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:03:14.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:03:14.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:03:14.579 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:03:14.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:03:14.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:03:14.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:03:14.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:03:14.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:03:14.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:03:14.766 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:03:14.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:03:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:03:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:03:16.909 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:03:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:17.897 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:17.898 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:03:18.310 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:03:19.715 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:03:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:21.473 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:21.474 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:03:23.842 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:03:24.469 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:24.469 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:03:26.778 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:26.926 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:03:27.408 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:27.409 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:03:29.958 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:03:29.998 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:30.996 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:30.996 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:03:31.635 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:03:31.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:03:31.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:03:31.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:03:31.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:03:31.802 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:03:31.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:03:31.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:03:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:03:31.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:03:31.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:03:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:03:31.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:03:31.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:03:32.808 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:03:33.497 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:03:34.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:03:34.434 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:03:34.920 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:03:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:03:37.627 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:03:37.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:03:37.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:03:37.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:03:37.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:03:37.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:03:37.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:03:38.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:03:38.041 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:03:38.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:03:38.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:03:38.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:03:38.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:03:38.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:03:38.447 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:03:39.114 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:03:40.841 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:03:41.139 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:03:41.140 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:03:41.140 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:03:41.140 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:03:41.141 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:03:42.184 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:03:43.154 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:03:43.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:03:43.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:03:43.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:03:43.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:03:43.980 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:03:44.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:03:44.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:03:44.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:03:44.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:03:44.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:03:44.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:03:44.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:03:44.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:03:44.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:03:45.197 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:03:45.806 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:03:46.036 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:03:46.950 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:03:48.725 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:03:49.723 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:03:50.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:03:50.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:03:50.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:03:50.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:03:50.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:03:50.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:03:50.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:03:50.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:03:50.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:03:50.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:03:50.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:03:50.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:03:50.583 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.585 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.585 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.585 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.585 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:03:50.925 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:03:52.445 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:03:52.445 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:03:52.445 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:03:52.445 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:03:52.446 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:03:53.117 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:03:53.638 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:03:53.914 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:03:55.998 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:03:55.998 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:03:55.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:03:55.998 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:03:55.998 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:03:56.900 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:03:57.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:03:57.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:03:57.368 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:03:57.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:03:57.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:03:57.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:03:57.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:03:57.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:03:57.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:03:57.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:03:57.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:03:57.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:03:57.638 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.639 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:03:57.936 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:03:59.825 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:04:00.424 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:04:00.463 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:04:00.936 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:04:03.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:04:03.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:04:03.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:04:03.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:04:03.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:04:03.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:04:03.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:04:03.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:04:03.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:04:03.777 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:04:03.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:04:03.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:04:03.835 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:04:03.961 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:04:03.961 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:04:03.961 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:04:03.961 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:04:03.961 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:04:04.366 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:04:04.825 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:04:07.142 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:04:07.277 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:04:07.277 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:04:07.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:04:07.277 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:04:07.278 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:04:07.408 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:04:07.906 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:04:11.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:04:11.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:04:11.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:04:11.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:04:11.271 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:04:11.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:04:11.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:04:11.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:04:11.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:04:11.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:04:11.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:04:11.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:04:11.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:04:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:04:11.885 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:04:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:04:14.305 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:04:14.514 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:04:14.805 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:04:15.374 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:04:17.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:04:17.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:04:17.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:04:17.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:04:17.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:04:18.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:04:18.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:04:18.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:04:18.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:04:18.139 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:04:18.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:04:18.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:04:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:04:18.302 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:04:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:04:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:04:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:04:18.303 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:04:18.956 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:04:19.230 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:04:20.988 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:04:21.373 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:21.691 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:04:22.240 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:22.241 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:04:24.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:04:24.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:04:24.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:04:24.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:04:24.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:04:24.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:04:24.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:04:24.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:04:24.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:04:24.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:04:24.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:04:24.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:04:24.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:04:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:04:25.599 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:25.963 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:04:26.276 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:26.276 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:04:27.267 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:04:28.673 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:04:28.799 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:29.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:29.374 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:04:30.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:04:30.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:04:30.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:04:30.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:04:30.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:04:30.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:04:30.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:04:30.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:04:30.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:04:30.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:04:30.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:04:30.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:04:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:04:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:04:32.465 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:32.953 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:04:33.146 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:33.146 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:04:33.435 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:04:35.524 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:04:35.695 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:35.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:04:35.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:04:35.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:04:35.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:04:36.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:04:36.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:04:36.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:04:36.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:04:36.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:04:36.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:04:36.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:04:36.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:04:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:04:36.621 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:36.622 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:04:38.961 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:04:39.149 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:04:39.522 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:40.245 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:40.246 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:04:41.672 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:04:42.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:04:42.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:04:42.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:04:42.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:04:42.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:04:42.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:04:42.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:04:42.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:04:42.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:04:42.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:04:42.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:04:42.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:04:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:04:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:04:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:44.444 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:44.444 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:04:44.994 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:04:45.861 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:04:46.762 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:47.488 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:47.489 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:04:47.752 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:04:49.396 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:04:49.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:04:49.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:04:49.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:04:49.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:04:49.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:04:49.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:04:49.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:04:49.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:04:49.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:04:49.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:04:49.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:04:49.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:04:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:04:50.779 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:04:51.425 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:51.425 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:04:52.543 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:04:53.903 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:53.946 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:04:54.961 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:54.962 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:04:55.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:04:55.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:04:55.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:04:55.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:04:55.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:04:55.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:04:55.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:04:55.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:04:55.745 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:04:55.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:04:55.798 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:04:55.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:04:55.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:04:55.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:04:57.920 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:04:57.967 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:04:58.686 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:04:58.735 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:04:58.736 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:05:00.936 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:05:01.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:01.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:01.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:01.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:01.418 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:01.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:01.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:01.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:01.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:01.599 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:01.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:05:01.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:05:01.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:05:01.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:05:02.534 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:02.535 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:05:04.374 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:05:04.943 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:05:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:06.088 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:06.089 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:05:07.084 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:05:07.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:07.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:07.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:07.860 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:07.891 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:07.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:07.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:07.971 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:08.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:08.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:08.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:05:08.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:05:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:05:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:05:09.835 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:10.546 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:10.546 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:05:10.960 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:05:11.115 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:05:13.361 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:13.718 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:05:13.947 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:13.947 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:05:14.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:14.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:14.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:14.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:14.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:14.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:14.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:14.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:14.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:14.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:14.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:05:14.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:05:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:05:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:05:16.969 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:16.970 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:05:17.924 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:05:18.087 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:18.087 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:05:19.898 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:05:20.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:20.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:20.657 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:20.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:20.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:20.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:20.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:20.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:20.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:20.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:20.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:20.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:05:20.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:05:20.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:05:20.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:05:22.068 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:22.069 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:05:23.085 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:05:24.069 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:05:24.604 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:25.267 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:25.267 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:05:26.046 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:05:26.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:26.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:26.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:26.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:26.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:26.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:26.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:26.734 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:26.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:26.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:26.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:05:26.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:05:26.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:05:26.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:05:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:29.355 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:29.356 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:05:29.768 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:05:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:05:32.391 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:32.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:33.000 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:33.000 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:05:33.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:33.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:33.054 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:05:33.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:33.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:33.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:33.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:33.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:33.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:33.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:05:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:05:33.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:05:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:05:35.762 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:36.159 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:05:36.432 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:36.432 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:05:36.986 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:05:39.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:39.041 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:39.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:39.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:39.094 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:39.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:39.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:39.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:39.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:39.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:39.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:39.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:05:39.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:05:39.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:05:39.731 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:39.732 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:05:40.201 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:05:42.144 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:05:42.349 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:43.306 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:43.306 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:05:44.382 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:05:45.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:45.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:45.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:45.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:45.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:45.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:45.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:45.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:45.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:45.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:45.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:05:45.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:05:46.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:05:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:05:47.118 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:05:47.118 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:05:47.758 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:05:48.716 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:05:49.786 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:05:49.787 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:05:49.787 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:05:49.787 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:05:50.580 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:05:51.996 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:05:52.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:52.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:52.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:52.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:53.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:53.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:53.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:53.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:53.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:53.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:53.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:05:53.308 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:05:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.312 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.312 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:05:53.867 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:05:54.379 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:05:54.996 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:05:55.918 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:05:56.890 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:05:57.800 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:05:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:05:59.728 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:05:59.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:05:59.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:05:59.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:05:59.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:05:59.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:05:59.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:05:59.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:05:59.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:05:59.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:05:59.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:00.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:00.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:06:00.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:06:01.232 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:06:01.233 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:06:01.233 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:06:01.233 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:06:01.783 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:06:01.875 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:06:02.646 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:06:05.425 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:06:05.425 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:06:05.425 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:06:05.425 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:06:05.426 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:06:05.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:06:05.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:06:05.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:06:05.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:06:05.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:06:05.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:06:05.870 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:06:05.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:06:05.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:06:05.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:06:05.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:05.998 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:06:06.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:06:06.195 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:06:08.745 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:06:08.762 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:06:09.082 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:06:09.480 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:06:12.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:06:12.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:06:12.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:06:12.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:06:12.730 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:06:12.757 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:06:12.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:06:12.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:06:12.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:06:12.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:06:12.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:12.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:12.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:06:12.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:06:13.008 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:06:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:06:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:06:13.009 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:06:13.043 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:06:14.056 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:06:15.914 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:06:16.009 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:06:16.169 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:06:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:06:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:06:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:06:16.169 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:06:17.068 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:06:19.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:06:19.746 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:06:19.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:06:19.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:06:19.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:06:19.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:06:19.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:06:19.904 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:06:19.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:06:19.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:06:19.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:20.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:20.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:06:20.143 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:06:20.999 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:06:21.021 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:06:22.849 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:06:23.220 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:06:23.519 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:06:24.053 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:06:26.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:06:26.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:06:26.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:06:26.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:06:26.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:06:26.441 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:06:26.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:06:26.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:06:26.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:06:26.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:06:26.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:26.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:06:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:06:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:06:27.530 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:06:27.530 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:06:27.530 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:06:27.530 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:06:27.530 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:06:28.311 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:06:29.388 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:06:30.139 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:06:30.785 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:06:30.785 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:06:30.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:06:30.786 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:06:30.786 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:06:31.756 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:06:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:06:32.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:06:32.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:06:32.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:06:32.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:06:32.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:06:32.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:06:32.891 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:06:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:06:32.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:06:32.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:33.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:33.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:06:33.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:06:34.015 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:06:35.004 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:06:35.596 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:06:35.597 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:06:35.859 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:06:36.655 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:06:39.107 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:06:39.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:06:39.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:06:39.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:06:39.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:06:39.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:06:39.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:06:39.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:06:39.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:06:39.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:06:39.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:06:39.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:39.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:39.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.529 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:06:39.598 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:06:39.599 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:06:41.209 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:06:42.277 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:06:42.376 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:06:42.980 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:06:42.980 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:06:43.932 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:06:44.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:06:44.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:06:44.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:06:44.860 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:06:44.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:06:44.924 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:06:44.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:06:44.982 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:06:45.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:06:45.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:06:45.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:45.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:45.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:06:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:06:46.505 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:06:47.246 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:06:47.247 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:06:47.829 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:06:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:06:50.122 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:06:50.886 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:06:50.886 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:06:51.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:06:51.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:06:51.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:06:51.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:06:51.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:06:51.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:06:51.292 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:06:51.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:06:51.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:06:51.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:06:51.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:06:51.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:51.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:51.442 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.442 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:06:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:06:53.766 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:06:54.432 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:06:54.433 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:06:54.445 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:06:54.560 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:06:57.046 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:06:57.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:06:57.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:06:57.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:06:57.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:06:57.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:06:57.609 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:06:57.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:06:57.648 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:06:57.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:06:57.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:06:57.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:06:57.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:06:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:06:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:06:57.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:06:58.662 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:06:58.663 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:07:01.029 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:07:01.059 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:07:01.137 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:02.161 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:02.162 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:07:03.868 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:07:04.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:07:04.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:07:04.355 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:07:04.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:07:04.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:07:04.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:07:04.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:07:04.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:07:04.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:07:04.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:07:04.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:07:04.576 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:04.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:07:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:07:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:07:05.651 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:05.651 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:07:08.007 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:07:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:07:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:09.088 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:09.088 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:07:10.870 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:07:11.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:07:11.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:07:11.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:07:11.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:07:11.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:07:11.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:07:11.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:07:11.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:07:11.566 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:07:11.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:07:11.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:07:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:07:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:07:11.671 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:12.579 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:12.579 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:07:14.398 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:07:14.978 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:07:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:15.921 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:15.921 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:07:17.177 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:07:18.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:07:18.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:07:18.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:07:18.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:07:18.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:07:18.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:07:18.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:07:18.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:07:18.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:07:18.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:07:18.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:07:18.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:07:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:07:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:07:19.243 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:19.997 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:19.997 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:07:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:07:21.304 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:07:22.444 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:23.330 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:23.331 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:07:23.928 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:07:24.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:07:24.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:07:24.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:07:24.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:07:24.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:07:24.355 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:07:24.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:07:24.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:07:24.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:07:24.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:07:24.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:07:24.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:07:24.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:07:24.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:07:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:27.204 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:27.204 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:07:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:07:27.679 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:07:30.151 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:30.283 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:07:30.829 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:30.830 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:07:30.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:07:30.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:07:30.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:07:30.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:07:30.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:07:30.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:07:31.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:07:31.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:07:31.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:07:31.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:07:31.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:07:31.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:07:31.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:07:31.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:07:33.698 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:34.293 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:07:34.359 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:34.360 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:07:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:07:36.949 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:07:37.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:07:37.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:07:37.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:07:37.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:07:37.439 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:07:37.467 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:07:37.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:07:37.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:07:37.590 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:37.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:07:37.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:07:37.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:07:37.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:07:37.704 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.704 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:07:37.706 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:07:38.537 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:38.537 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:07:40.853 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:07:40.911 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:41.575 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:41.576 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:07:42.051 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:07:44.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:07:44.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:07:44.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:07:44.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:07:44.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:07:44.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:07:44.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:07:44.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:07:44.271 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:44.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:07:44.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:07:44.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:07:44.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:07:44.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:07:44.908 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:07:45.115 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:45.116 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:07:47.264 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:07:47.700 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:48.075 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:07:48.599 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:48.599 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:07:50.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:07:50.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:07:50.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:07:50.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:07:50.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:07:50.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:07:50.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:07:50.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:07:50.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:07:50.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:07:50.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:07:50.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:07:50.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:07:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:07:51.290 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:07:51.328 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:52.036 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:52.036 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:07:53.357 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:07:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:07:54.544 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:55.468 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:55.469 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:07:56.975 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:07:57.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:07:57.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:07:57.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:07:57.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:07:57.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:07:57.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:07:57.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:07:57.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:07:57.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:07:57.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:07:57.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:07:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:07:57.997 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:07:58.045 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:07:58.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:07:58.679 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:07:59.956 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:08:01.055 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:08:01.918 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:08:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:08:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:08:01.919 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:08:02.641 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:08:03.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:08:03.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:08:03.301 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:08:03.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:08:03.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:08:03.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:08:03.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:08:03.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:08:03.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:08:03.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:08:03.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:08:03.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:08:03.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:08:03.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:08:04.090 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:08:05.082 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:08:05.773 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:08:06.582 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:08:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:08:08.590 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:08:09.481 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:08:09.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:08:09.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:08:09.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:08:09.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:08:09.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:08:09.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:08:10.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:08:10.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:08:10.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:08:10.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:08:10.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:08:10.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:08:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:08:10.949 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:08:12.348 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:08:12.348 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:08:12.349 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:08:12.349 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:08:12.888 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:08:13.040 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:08:14.409 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:08:15.675 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:08:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:08:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:08:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:08:15.676 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:08:16.409 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:08:16.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:08:16.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:08:16.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:08:16.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:08:16.602 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:08:16.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:08:16.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:08:16.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:08:16.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:08:16.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:08:16.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:08:16.840 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:08:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:08:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:08:17.251 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:08:19.131 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:08:19.514 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:08:19.920 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:08:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:08:22.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:08:22.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:08:22.499 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:08:22.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:08:22.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:08:22.575 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:08:22.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:08:22.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:08:22.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:08:22.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:08:22.682 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:08:22.682 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:08:22.682 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:08:22.682 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:08:22.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:08:22.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:08:22.734 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.734 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.734 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.734 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.734 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.734 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.735 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.735 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.735 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.735 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.735 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:08:22.735 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:08:23.459 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:08:23.993 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:08:25.642 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:08:25.882 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:08:25.882 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:08:25.882 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:08:25.882 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:08:25.882 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:08:26.595 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:08:28.082 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:08:28.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:08:28.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:08:28.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:08:28.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:08:28.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:08:28.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:08:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:08:29.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:08:29.047 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:08:29.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:08:29.106 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:08:29.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:08:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:08:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:08:30.347 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:08:30.938 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:08:31.299 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:08:31.886 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:08:33.719 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:08:34.712 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:08:35.125 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:08:35.246 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:08:35.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:08:35.293 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:08:35.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:08:35.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:08:35.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:08:35.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:08:35.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:08:35.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:08:35.499 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:08:35.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:08:35.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:08:35.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:08:35.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:08:37.377 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:08:37.378 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:08:37.378 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:08:37.378 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:08:37.378 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:08:37.926 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:08:38.006 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:08:38.478 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:08:41.464 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:08:41.464 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:08:41.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:08:41.464 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:08:41.465 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:08:41.533 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:08:41.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:08:41.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:08:41.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:08:41.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:08:41.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:08:41.685 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:08:41.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:08:41.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:08:41.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:08:41.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:08:41.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:08:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:08:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:08:42.086 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:08:42.107 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:08:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:08:44.701 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:08:45.057 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:08:45.348 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:08:45.349 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:08:48.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:08:48.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:08:48.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:08:48.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:08:48.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:08:48.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:08:48.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:08:48.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:08:48.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:08:48.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:08:48.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:08:48.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:08:48.398 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:08:48.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:08:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:08:49.100 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:08:49.772 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:08:49.772 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:08:51.153 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:08:51.812 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:08:51.926 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:08:52.572 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:08:52.572 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:08:54.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:08:54.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:08:54.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:08:54.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:08:54.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:08:54.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:08:54.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:08:54.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:08:54.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:08:54.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:08:54.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:08:54.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:08:54.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:08:54.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:08:55.918 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:08:56.651 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:08:56.651 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:08:57.094 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:08:57.803 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:08:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:08:59.840 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:08:59.985 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:08:59.985 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:09:00.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:09:00.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:09:00.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:09:00.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:09:00.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:09:00.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:09:00.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:09:00.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:09:00.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:09:00.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:09:00.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:09:00.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:09:00.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:09:00.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:09:03.137 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:03.363 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:09:03.747 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:03.748 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:09:03.893 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:09:06.220 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:09:06.531 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:07.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:09:07.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:09:07.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:09:07.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:09:07.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:09:07.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:09:07.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:09:07.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:09:07.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:09:07.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:09:07.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:09:07.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:09:07.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:09:07.444 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:07.444 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:09:09.971 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:09:10.139 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:09:10.219 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:11.262 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:11.262 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:09:12.996 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:09:13.264 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:09:13.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:09:13.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:09:13.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:09:13.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:09:13.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:09:13.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:09:13.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:09:13.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:09:13.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:09:13.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:09:13.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:09:13.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:09:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:09:14.899 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:15.619 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:15.619 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:09:16.088 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:09:16.407 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:09:18.371 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:18.814 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:09:18.913 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:18.913 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:09:19.463 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:09:19.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:09:19.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:09:19.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:09:19.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:09:19.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:09:19.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:09:19.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:09:19.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:09:19.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:09:19.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:09:19.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:09:19.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:09:19.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:09:22.027 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:09:22.717 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:22.718 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:09:22.939 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:09:25.120 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:09:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:25.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:09:25.995 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:25.995 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:09:26.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:09:26.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:09:26.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:09:26.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:09:26.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:09:26.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:09:26.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:09:26.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:09:26.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:09:26.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:09:26.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:09:26.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:09:26.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:09:28.728 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:29.140 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:09:29.387 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:09:29.407 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:29.476 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:09:31.837 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:09:32.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:09:32.130 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:09:32.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:09:32.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:09:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:09:32.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:09:32.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:09:32.300 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:09:32.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:09:32.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:09:32.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:09:32.370 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:32.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:09:32.398 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.398 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:09:32.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:09:33.368 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:33.369 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:09:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:09:35.537 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:09:35.849 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:36.473 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:36.473 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:09:37.924 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:09:39.903 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:40.611 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:40.612 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:09:41.102 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:09:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:43.438 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:43.439 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:09:43.847 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:09:46.154 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:46.855 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:46.855 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:09:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:09:48.533 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:09:48.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:09:48.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:09:48.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:09:48.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:09:48.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:09:48.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:09:48.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:09:48.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:09:48.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:09:48.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:09:48.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:09:48.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:09:48.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:09:49.545 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:50.070 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:50.071 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:09:50.215 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:09:51.448 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:09:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:53.687 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:53.687 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:09:54.431 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:09:54.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:09:54.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:09:54.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:09:54.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:09:54.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:09:54.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:09:54.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:09:54.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:09:54.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:09:54.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:09:54.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:09:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:09:54.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:09:54.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:09:56.637 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:09:57.207 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:09:57.256 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:09:57.256 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:09:57.763 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:10:00.502 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:10:01.117 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:10:01.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:01.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:01.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:01.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:01.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:01.286 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:10:01.286 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:10:01.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:01.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:01.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:01.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:01.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:01.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:01.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:01.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:10:01.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:10:03.748 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:10:03.873 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:10:04.414 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:10:04.492 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:10:04.493 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:10:07.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:07.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:07.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:07.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:07.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:07.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:07.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:07.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:07.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:10:08.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:08.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:08.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:10:08.130 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:10:08.908 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:10:08.909 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:10:11.145 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:10:11.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:10:11.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:10:11.719 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:10:14.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:14.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:14.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:14.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:14.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:14.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:14.840 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:14.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:14.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:14.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:14.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:14.942 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:10:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:10:15.026 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:10:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:10:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:10:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:10:15.027 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:10:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:10:15.951 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:10:17.760 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:10:18.163 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:10:18.163 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:10:18.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:10:18.163 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:10:18.163 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:10:18.333 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:10:19.052 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:10:20.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:21.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:21.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:21.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:21.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:21.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:21.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:21.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:21.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:21.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:10:21.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:10:22.477 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:10:23.115 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:10:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:10:24.247 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:10:25.588 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:10:25.703 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:10:26.683 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:10:28.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:28.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:28.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:28.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:28.075 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:28.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:28.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:28.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:28.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:28.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:28.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:28.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:28.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:10:28.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:10:29.851 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:10:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:10:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:10:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:10:29.852 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:10:30.152 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:10:30.439 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:10:31.400 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:10:32.774 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:10:32.775 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:10:32.775 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:10:32.775 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:10:32.878 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:10:33.817 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:10:34.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:34.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:34.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:34.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:34.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:34.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:34.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:34.705 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:34.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:34.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:34.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.821 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.821 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.821 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.821 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:10:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:10:36.813 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:10:37.187 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:10:37.536 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:10:37.658 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:10:39.992 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:10:40.420 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:10:40.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:40.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:40.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:40.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:40.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:40.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:40.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:40.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:40.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:40.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:40.797 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:40.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:40.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:10:40.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:10:41.217 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:10:43.743 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:10:44.012 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:10:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:10:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:10:44.013 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:10:44.441 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:10:44.785 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:10:46.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:46.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:47.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:47.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:47.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:47.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:47.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:47.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:47.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:47.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:47.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:47.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:47.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:10:47.374 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:10:47.830 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:10:48.676 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:10:49.942 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:10:51.141 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:10:52.015 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:10:52.878 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:10:53.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:53.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:53.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:53.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:53.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:53.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:53.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:53.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:53.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:53.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:53.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:53.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:10:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:10:54.310 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:10:56.176 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:10:56.477 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:10:56.885 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:10:56.886 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:10:57.143 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:10:59.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:10:59.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:10:59.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:10:59.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:10:59.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:10:59.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:10:59.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:10:59.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:10:59.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:10:59.742 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:10:59.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:10:59.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:10:59.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:10:59.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:10:59.929 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:11:00.585 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:00.586 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:11:02.848 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:11:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:11:03.182 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:04.539 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:04.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:11:06.248 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:11:06.804 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:07.458 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:07.458 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:11:09.189 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:11:09.841 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:10.311 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:10.311 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:11:11.837 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:11:12.452 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:13.062 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:13.062 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:11:14.623 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:11:15.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:11:15.509 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:15.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:11:15.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:11:15.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:11:15.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:11:15.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:11:15.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:11:15.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:11:15.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:11:15.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:11:15.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:11:15.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:11:15.783 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.783 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.783 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:11:15.997 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:15.997 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:11:17.432 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:11:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:18.387 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:11:19.425 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:19.426 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:11:21.165 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:11:22.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:11:22.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:11:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:22.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:11:22.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:11:22.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:11:22.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:11:22.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:11:22.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:11:22.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:11:22.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:11:22.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:11:22.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:11:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:11:22.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:22.907 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:11:24.283 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:11:25.113 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:25.223 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:11:25.815 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:25.816 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:11:28.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:11:28.793 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:11:28.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:11:28.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:11:28.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:11:28.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:11:28.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:11:28.954 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:11:28.961 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:28.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:11:29.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:11:29.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:11:29.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:11:29.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:11:29.297 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:11:29.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:29.841 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:11:32.062 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:32.149 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:11:32.368 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:11:32.598 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:32.598 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:11:35.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:11:35.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:11:35.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:11:35.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:11:35.485 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:11:35.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:11:35.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:11:35.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:11:35.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:11:35.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:11:35.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:11:35.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:11:35.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:11:35.783 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:36.163 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:11:36.984 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:36.984 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:11:38.633 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:11:39.155 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:11:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:39.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:39.979 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:11:42.093 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:11:42.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:11:42.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:11:42.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:11:42.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:11:42.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:11:42.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:11:42.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:11:42.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:11:42.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:11:42.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:11:42.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:11:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:11:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:11:43.152 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:43.852 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:43.852 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:11:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:11:45.341 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:11:46.192 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:46.922 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:46.923 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:11:47.379 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:11:48.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:11:48.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:11:48.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:11:48.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:11:48.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:11:48.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:11:48.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:11:48.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:11:48.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:11:48.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:11:48.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:11:48.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:11:48.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:11:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:11:50.068 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:50.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:50.766 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:11:51.182 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:11:51.333 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:11:53.621 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:53.913 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:11:54.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:11:54.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:11:54.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:11:54.452 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:54.452 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:11:54.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:11:54.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:11:54.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:11:54.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:11:54.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:11:54.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:11:54.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:11:54.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:11:54.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:11:54.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:11:54.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:11:57.326 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:11:57.597 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:11:58.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:11:58.020 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:12:00.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:00.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:00.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:00.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:00.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:00.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:00.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:00.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:00.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:00.929 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:12:00.942 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:00.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:00.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:01.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:12:01.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:12:01.741 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:12:01.741 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:12:04.018 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:12:04.371 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:12:04.519 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:12:05.177 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:12:05.178 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:12:07.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:07.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:07.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:07.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:07.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:07.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:07.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:07.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:07.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:07.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:07.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:07.618 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:07.621 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.621 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.621 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.621 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:12:07.684 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:12:08.155 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:12:08.950 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:12:08.950 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:12:10.301 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:12:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:12:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:12:12.956 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:12:12.957 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:12:13.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:13.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:13.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:13.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:13.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:13.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:13.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:13.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:13.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:13.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:13.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:13.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:12:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:12:14.212 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:12:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:12:16.622 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:12:16.622 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:12:16.904 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:12:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:12:19.731 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:12:19.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:20.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:20.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:20.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:20.088 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:20.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:20.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:20.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:20.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:20.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:20.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:20.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:20.273 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:12:20.574 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:12:20.896 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:12:22.993 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:12:23.176 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:12:23.176 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:12:23.177 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:12:23.177 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:12:23.177 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:12:24.025 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:12:24.463 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:12:26.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:26.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:26.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:26.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:26.694 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:26.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:26.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:26.773 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:26.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:26.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:26.843 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:12:26.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:26.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.853 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.853 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.853 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.853 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:12:26.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:12:27.660 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:12:27.667 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:12:29.861 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:12:30.507 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:12:31.189 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:12:31.194 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:12:33.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:33.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:33.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:33.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:33.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:33.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:33.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:33.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:33.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:33.489 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.489 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.489 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.489 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.489 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.489 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:12:33.779 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:12:33.779 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:12:33.779 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:12:33.779 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:12:33.779 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:12:34.113 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:12:34.599 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:12:36.203 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:12:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:12:37.230 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:12:37.230 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:12:37.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:12:37.231 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:12:37.231 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:12:38.367 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:12:39.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:39.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:39.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:39.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:39.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:39.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:39.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:39.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:39.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:39.361 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:39.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:12:39.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:12:40.652 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:12:41.709 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:12:42.374 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:12:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:12:45.258 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:12:45.960 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:12:46.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:46.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:46.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:46.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:46.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:46.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:46.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:46.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:46.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:46.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:46.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:46.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:46.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:12:46.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:12:47.496 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:12:48.248 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:12:48.248 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:12:48.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:12:48.248 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:12:48.249 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:12:49.101 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:12:49.206 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:12:51.511 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:12:52.188 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:12:52.188 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:12:52.188 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:12:52.188 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:12:52.439 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:52.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:52.489 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:52.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:52.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:52.566 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:52.592 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:52.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:52.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:52.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:52.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:52.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:52.729 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.729 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.729 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.729 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.729 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.729 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.730 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.730 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.730 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.730 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.730 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.730 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:12:52.840 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:12:54.410 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:12:55.151 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:12:55.316 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:12:56.031 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:12:58.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:12:58.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:12:58.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:12:58.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:12:58.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:12:58.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:12:58.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:12:58.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:12:58.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:12:59.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:12:59.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:12:59.056 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:12:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:12:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:12:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:12:59.057 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:12:59.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:12:59.067 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.067 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.067 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.067 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.067 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.067 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:12:59.209 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:12:59.938 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:13:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:02.269 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:13:02.483 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:13:02.863 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:02.864 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:13:05.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:13:05.676 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:13:05.699 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:13:05.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:13:05.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:13:05.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:13:05.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:13:05.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:13:05.860 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:13:05.887 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:13:05.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:13:05.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:13:05.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:13:06.215 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:13:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:07.543 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:07.544 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:13:08.637 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:13:09.357 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:13:10.523 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:11.331 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:11.332 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:13:11.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:13:11.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:13:11.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:13:11.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:13:11.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:13:11.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:13:11.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:13:11.728 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:13:11.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:13:11.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:13:11.863 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:13:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:13:13.246 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:13:14.536 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:14.708 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:13:15.318 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:15.319 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:13:15.966 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:13:18.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:13:18.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:13:18.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:13:18.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:13:18.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:13:18.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:13:18.170 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:13:18.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:13:18.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:13:18.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:13:18.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:13:18.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:13:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:13:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:19.122 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:19.122 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:13:20.470 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:13:21.464 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:13:21.655 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:22.506 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:22.506 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:13:23.222 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:13:24.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:13:24.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:13:24.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:13:24.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:13:24.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:13:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:13:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:13:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:26.520 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:26.521 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:13:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:13:27.546 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:13:29.394 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:30.012 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:30.012 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:13:30.126 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:13:30.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:13:30.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:13:30.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:13:30.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:13:30.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:13:30.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:13:30.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:13:30.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:13:30.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:13:30.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:13:30.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:13:30.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:13:33.034 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:33.521 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:13:33.710 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:33.710 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:13:36.133 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:36.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:36.720 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:13:38.718 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:39.234 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:39.235 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:13:41.241 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:41.804 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:41.804 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:13:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:13:43.862 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:44.376 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:44.376 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:13:45.932 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:13:46.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:13:46.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:13:46.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:13:46.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:13:46.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:13:46.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:13:46.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:13:46.316 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:13:46.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:13:46.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:13:46.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:13:46.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:13:46.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:13:46.424 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:47.497 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:47.498 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:13:49.252 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:13:49.311 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:13:50.075 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:50.864 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:50.865 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:13:52.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:13:52.117 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:13:52.118 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:13:52.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:13:52.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:13:52.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:13:52.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:13:52.246 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:13:52.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:13:52.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:13:52.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:13:52.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:13:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:13:52.393 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:13:52.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:13:54.183 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:54.858 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:54.858 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:13:55.185 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:13:56.239 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:13:57.767 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:13:58.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:13:58.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:13:58.440 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:13:58.440 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:13:58.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:13:58.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:13:58.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:13:58.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:13:58.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:13:58.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:13:58.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:13:58.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:13:58.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:13:58.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:13:58.745 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:13:58.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:13:59.351 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:14:01.008 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:14:01.531 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:14:01.531 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:14:01.555 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:14:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:14:04.418 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:14:04.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:14:04.467 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:14:04.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:14:04.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:14:04.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:14:04.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:14:04.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:14:04.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:14:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:14:04.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:14:04.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:14:04.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:14:05.516 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:14:05.517 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:14:06.188 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:14:07.767 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:14:08.196 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:14:09.085 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:14:09.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:14:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:14:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:14:12.743 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:14:12.743 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:14:13.508 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:14:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:14:15.871 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:14:15.871 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:14:17.255 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:14:18.362 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:14:18.952 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:14:18.953 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:14:19.765 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:14:21.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:14:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:14:21.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:14:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:14:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:14:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:14:21.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:14:21.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:14:21.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:14:21.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:14:21.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:14:21.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:14:21.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:14:21.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:14:21.936 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:14:21.937 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:14:23.259 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:14:24.569 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:14:24.745 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:14:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:14:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:14:24.746 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:14:25.659 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:14:26.258 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:14:28.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:14:28.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:14:28.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:14:28.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:14:28.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:14:28.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:14:28.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:14:28.566 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:14:28.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:14:28.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:14:28.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:14:28.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:14:28.912 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:14:29.852 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:14:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:14:31.472 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:14:32.064 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:14:32.769 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:14:33.023 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:14:34.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:14:34.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:14:34.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:14:34.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:14:34.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:14:34.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:14:34.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:14:34.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:14:34.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:14:34.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:14:34.746 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:14:34.773 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:14:34.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:14:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:14:36.122 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:14:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:14:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:14:36.122 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:14:36.784 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:14:37.498 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:14:37.781 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:14:39.823 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:14:39.823 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:14:39.823 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:14:39.823 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:14:39.824 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:14:40.376 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:14:40.519 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:14:40.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:14:40.962 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:14:40.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:14:41.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:14:41.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:14:41.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:14:41.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:14:41.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:14:41.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:14:41.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:14:41.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:14:41.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:14:41.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:14:41.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:14:43.534 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:14:44.228 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:14:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:14:44.543 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:14:47.255 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:14:47.303 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:14:47.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:14:47.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:14:47.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:14:47.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:14:47.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:14:47.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:14:47.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:14:47.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:14:47.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:14:47.746 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:14:47.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:14:47.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:14:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:14:47.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:14:48.185 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:14:50.652 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:14:50.913 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:14:50.913 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:14:50.913 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:14:50.914 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:14:50.914 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:14:51.265 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:14:51.700 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:14:53.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:14:53.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:14:53.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:14:53.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:14:53.904 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:14:53.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:14:53.970 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:14:54.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:14:54.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:14:54.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:14:54.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:14:54.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:14:54.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:14:54.221 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:14:54.397 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:14:55.559 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:14:56.879 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:14:58.274 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:14:58.338 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:14:59.622 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:15:00.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:00.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:00.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:00.247 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:00.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:00.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:00.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:00.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:00.412 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:00.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:00.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:00.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:00.499 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.499 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.499 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.499 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:15:00.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:15:01.438 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:15:01.977 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:15:01.978 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:15:01.978 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:15:01.978 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:15:01.978 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:15:02.678 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:15:03.487 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:15:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:15:05.883 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:15:05.884 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:15:05.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:15:05.884 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:15:05.884 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:15:06.724 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:15:06.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:06.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:06.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:06.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:06.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:06.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:06.982 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:07.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:07.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:07.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:07.088 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:07.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:07.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:15:07.782 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:15:08.983 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:09.786 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:15:09.949 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:09.950 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:15:11.274 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:15:12.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:12.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:12.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:12.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:12.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:12.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:12.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:12.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:12.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:12.821 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:12.852 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:12.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:12.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:15:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:15:13.673 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:13.674 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:15:14.148 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:15:15.838 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:15:16.230 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:17.214 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:17.214 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:15:17.278 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:15:18.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:18.962 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:18.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:19.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:19.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:19.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:19.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:19.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:19.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:19.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:19.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:19.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:15:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:15:20.268 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:15:20.402 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:21.122 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:21.123 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:15:21.832 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:15:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:24.497 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:15:25.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:25.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:25.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:25.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:25.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:25.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:25.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:25.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:25.315 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:25.315 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:15:25.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:25.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:25.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:25.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:25.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.450 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:15:25.451 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:15:27.502 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:15:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:27.967 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:15:28.418 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:28.419 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:15:31.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:31.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:31.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:31.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:31.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:31.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:31.612 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:31.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:31.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:31.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:31.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:31.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:31.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.743 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.743 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.743 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.743 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.743 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:15:31.828 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:32.286 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:15:32.877 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:32.877 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:15:34.571 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:15:34.966 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:35.031 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:15:35.676 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:35.677 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:15:38.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:38.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:38.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:38.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:38.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:38.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:38.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:38.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:38.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:38.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:38.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:38.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:15:38.720 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:15:39.872 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:39.872 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:15:41.535 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:15:41.887 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:42.020 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:15:42.817 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:42.818 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:15:44.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:44.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:44.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:45.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:45.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:45.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:45.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:45.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:45.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:45.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:45.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:45.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:15:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:15:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:46.299 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:15:46.520 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:46.520 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:15:48.141 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:15:48.619 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:48.916 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:15:49.480 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:49.480 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:15:51.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:51.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:51.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:51.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:51.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:51.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:51.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:51.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:52.029 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:52.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:52.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:52.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:52.133 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.134 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.134 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.134 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.134 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.134 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.134 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.134 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:15:52.392 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:53.359 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:53.360 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:15:54.501 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:15:54.892 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:15:55.760 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:15:56.546 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:15:56.547 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:15:57.289 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:15:57.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:15:57.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:15:57.766 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:15:57.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:15:57.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:15:57.852 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:15:57.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:15:57.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:15:57.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:15:57.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:15:57.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:15:58.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:15:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:15:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:15:59.676 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:00.217 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:00.218 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:16:00.813 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:16:01.520 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:16:03.350 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:03.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:16:04.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:16:04.064 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:04.065 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:16:04.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:16:04.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:16:04.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:16:04.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:16:04.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:16:04.247 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:16:04.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:16:04.316 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:16:04.347 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:16:04.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:16:04.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:16:04.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:16:04.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:16:07.043 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:16:07.062 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:16:07.766 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:07.766 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:16:10.393 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:16:10.441 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:16:10.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:16:10.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:16:10.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:16:10.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:16:10.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:16:10.599 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:16:10.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:16:10.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:16:10.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:16:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:10.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:16:10.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:16:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.745 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.745 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.745 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.745 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.745 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:16:10.746 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:16:11.671 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:11.672 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:16:13.874 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:16:14.386 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:14.539 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:16:15.262 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:15.262 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:16:17.626 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:16:17.771 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:18.332 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:18.332 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:16:20.753 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:21.364 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:21.364 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:16:21.504 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:16:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:24.101 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:16:24.304 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:24.305 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:16:26.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:16:26.673 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:16:26.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:16:26.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:16:26.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:16:26.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:16:26.802 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:16:26.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:16:26.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:16:26.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:16:26.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:16:26.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:16:26.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.942 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.942 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:16:26.956 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:27.317 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:16:27.791 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:27.792 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:16:30.066 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:16:30.068 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:16:30.253 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:16:30.614 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:16:30.614 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:16:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:16:33.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:16:33.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:16:33.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:16:33.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:16:33.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:16:33.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:16:33.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:16:33.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:16:33.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:16:33.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:16:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:16:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:16:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:16:34.358 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:16:34.534 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:16:35.097 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:16:36.460 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:16:37.294 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:16:37.346 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:16:38.013 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:16:39.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:16:40.029 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:16:40.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:16:40.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:16:40.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:16:40.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:16:40.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:16:40.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:16:40.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:16:40.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:16:40.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:16:40.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:16:40.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:16:40.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:16:41.509 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:16:41.669 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:16:41.669 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:16:41.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:16:41.669 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:16:41.670 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:16:42.484 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:16:43.347 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:16:44.086 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:16:45.429 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:16:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:16:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:16:45.430 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:16:46.254 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:16:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:16:46.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:16:46.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:16:46.897 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:16:46.924 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:16:46.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:16:46.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:16:47.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:16:47.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:16:47.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:16:47.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:16:47.117 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:16:47.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:16:47.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:16:48.336 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:16:49.345 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:16:49.895 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:16:50.184 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:16:51.073 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:16:52.851 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:16:53.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:16:53.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:16:53.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:16:53.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:16:53.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:16:53.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:16:53.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:16:53.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:16:53.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:16:53.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:16:53.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:16:53.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:16:53.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.827 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:16:53.845 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:16:55.519 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:16:56.492 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:16:56.727 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:16:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:16:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:16:56.728 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:16:57.503 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:16:58.095 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:16:59.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:16:59.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:16:59.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:16:59.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:16:59.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:16:59.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:16:59.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:16:59.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:00.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:00.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:00.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:00.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:00.093 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.093 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.093 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:17:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:17:01.302 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:17:02.051 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:17:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:17:02.871 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:17:04.791 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:17:05.166 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:17:05.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:17:05.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:17:05.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:17:05.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:17:05.662 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:17:05.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:17:05.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:17:05.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:17:05.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:05.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:05.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:05.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:05.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:05.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:17:05.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:17:08.354 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:17:08.454 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:17:08.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:17:08.455 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:17:08.455 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:17:08.731 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:17:09.428 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:17:11.160 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:17:11.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:17:11.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:17:11.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:17:11.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:17:11.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:17:11.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:17:11.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:17:11.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:12.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:12.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:12.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:12.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:12.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.096 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:17:12.102 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:17:13.337 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:17:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:17:15.339 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:17:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:17:16.561 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:17:17.213 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:17:18.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:17:18.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:17:18.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:17:18.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:17:18.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:17:18.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:17:18.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:17:18.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:18.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:18.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:18.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:18.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:17:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:17:19.657 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:20.365 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:20.365 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:17:21.195 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:17:21.567 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:17:22.884 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:23.761 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:23.761 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:17:24.241 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:17:24.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:17:24.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:17:24.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:17:24.438 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:17:24.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:17:24.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:17:24.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:17:24.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:24.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:24.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:24.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:24.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:17:24.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:17:26.731 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:27.464 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:27.465 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:17:27.957 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:17:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:17:30.481 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:31.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:17:31.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:17:31.194 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:31.195 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:17:31.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:17:31.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:17:31.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:17:31.300 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:17:31.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:17:31.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:31.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:31.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:31.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:31.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:17:31.464 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:17:34.100 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:34.189 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:17:34.571 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:17:34.823 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:34.824 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:17:37.452 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:17:37.555 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:17:37.579 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:17:37.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:17:37.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:17:37.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:17:37.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:17:37.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:17:37.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:37.791 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:37.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:37.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:37.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:37.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:17:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:17:39.070 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:39.070 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:17:40.891 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:17:41.406 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:41.520 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:17:42.432 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:42.432 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:17:43.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:17:43.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:17:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:17:43.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:17:43.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:17:44.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:17:44.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:17:44.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:44.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:44.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:44.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:44.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:44.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:17:44.843 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:17:45.407 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:46.108 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:46.109 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:17:46.853 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:17:48.382 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:17:49.187 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:49.824 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:49.825 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:17:50.357 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:17:50.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:17:50.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:17:50.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:17:50.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:17:50.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:17:50.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:17:50.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:50.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:50.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:50.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:50.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:50.707 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.707 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.707 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:17:50.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:17:51.395 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:17:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:52.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:52.906 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:17:53.598 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:17:54.690 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:17:55.970 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:17:56.471 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:17:56.471 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:17:57.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:17:57.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:17:57.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:17:57.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:17:57.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:17:57.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:17:57.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:17:57.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:17:57.294 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:17:57.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:17:57.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:17:57.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:17:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:17:57.585 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:17:59.183 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:00.004 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:00.004 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:18:00.448 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:18:01.527 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:18:03.119 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:03.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:18:03.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:18:03.843 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:03.843 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:18:03.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:18:03.899 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:18:03.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:18:03.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:18:03.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:18:04.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:18:04.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:18:04.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:18:04.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:18:04.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:18:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:18:04.231 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:18:06.879 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:18:06.899 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:07.591 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:07.592 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:18:08.377 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:18:10.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:18:10.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:18:10.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:18:10.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:18:10.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:18:10.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:18:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:10.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:18:10.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:18:10.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:18:10.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:18:10.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:18:10.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:18:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:18:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:18:11.501 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:11.501 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:18:11.557 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:18:13.741 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:18:14.587 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:15.537 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:18:15.852 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:15.852 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:18:18.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:18:18.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:18:18.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:18:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:18:18.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:18:18.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:18:18.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:18:18.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:18:18.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:18:18.439 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:18:18.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:18:18.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:18:18.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.494 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.494 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.494 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.494 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.494 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:18:18.652 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:18:19.151 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:20.037 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:20.037 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:18:21.315 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:18:22.548 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:18:23.745 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:24.447 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:24.447 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:18:25.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:18:25.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:18:25.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:18:25.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:18:25.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:18:25.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:18:25.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:18:25.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:18:25.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:18:25.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:18:25.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:18:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:18:25.807 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:28.528 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:28.528 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:18:28.779 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:18:29.485 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:18:31.851 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:32.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:18:32.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:18:32.596 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:32.597 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:18:32.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:18:32.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:18:32.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:18:32.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:18:32.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:18:32.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:18:32.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:18:32.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:18:32.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:18:32.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:18:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:18:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:18:33.050 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:18:35.758 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:18:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:36.566 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:36.566 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:18:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:18:39.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:18:39.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:18:39.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:18:39.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:18:39.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:18:39.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:18:39.618 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:18:39.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:18:39.672 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:18:39.699 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:18:39.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:18:39.739 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:39.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:18:39.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:18:39.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:18:40.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:40.684 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:18:40.757 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:18:42.921 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:18:43.428 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:44.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:44.347 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:18:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:18:46.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:18:46.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:18:46.904 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:18:46.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:18:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:18:47.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:18:47.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:18:47.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:18:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:18:47.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:18:47.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:18:47.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:18:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:18:47.366 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:18:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:18:48.645 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:18:48.645 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:18:50.012 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:18:51.380 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:18:51.549 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:18:52.856 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:18:53.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:18:53.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:18:53.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:18:53.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:18:53.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:18:53.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:18:53.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:18:53.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:18:53.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:18:53.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:18:53.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:18:53.718 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:18:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:18:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:18:54.259 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:18:55.568 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:18:55.568 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:18:55.568 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:18:55.568 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:18:55.568 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:18:56.694 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:18:56.838 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:18:57.460 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:18:59.636 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:18:59.636 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:18:59.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:18:59.636 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:18:59.636 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:19:00.301 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:19:00.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:00.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:00.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:00.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:00.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:00.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:19:00.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:19:00.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:19:00.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:19:00.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:19:00.647 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:19:00.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:19:00.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:19:00.690 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.690 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.690 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:19:00.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:19:03.132 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:19:03.661 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:19:03.760 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:19:04.528 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:19:06.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:06.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:06.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:07.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:07.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:07.075 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:19:07.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:19:07.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:19:07.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:19:07.168 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:19:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:19:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:19:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:19:07.168 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:19:07.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:19:07.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:19:07.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:19:07.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.244 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.244 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.244 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:19:07.583 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:19:08.146 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:19:10.324 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:19:10.995 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:19:10.996 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:19:10.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:19:10.996 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:19:10.997 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:19:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:19:11.772 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:19:13.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:13.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:13.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:13.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:13.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:13.599 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:19:13.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:19:13.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:19:13.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:19:13.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:19:13.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:19:13.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:19:13.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:19:13.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:19:14.871 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:19:16.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:19:16.650 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:19:19.379 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:19:19.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:19.672 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:19.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:19.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:19.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:19.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:19:19.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:19:19.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:19:19.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:19:19.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:19:19.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:19:19.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:19:19.996 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.997 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.997 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.997 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.997 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.997 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:19:19.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:19:20.248 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:19:22.700 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:19:22.701 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:19:22.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:19:22.701 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:19:22.701 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:19:22.829 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:19:23.443 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:19:25.824 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:25.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:25.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:25.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:25.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:25.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:19:25.982 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:19:26.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:19:26.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:19:26.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:19:26.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:19:26.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:19:26.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:19:26.134 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:19:27.259 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:19:28.429 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:19:29.042 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:19:29.738 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:19:30.513 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:19:31.338 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:19:31.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:31.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:31.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:31.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:31.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:31.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:19:32.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:19:32.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:19:32.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:19:32.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:19:32.118 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:19:32.139 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:19:32.140 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.140 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.140 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:19:32.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:19:34.041 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:19:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:19:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:19:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:19:34.042 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:19:34.780 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:19:35.188 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:19:35.460 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:19:37.938 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:19:38.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:38.658 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:38.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:38.805 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:19:38.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:38.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:38.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:19:38.806 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:19:38.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:19:38.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:19:38.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:19:38.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:19:38.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:19:38.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:19:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:19:38.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:19:41.940 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:19:42.378 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:19:42.543 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:19:42.604 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:19:42.604 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:19:45.171 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:19:45.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:45.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:45.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:45.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:45.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:45.761 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:19:45.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:19:45.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:19:45.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:19:45.862 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:19:45.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:19:45.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:19:45.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:19:45.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.958 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.958 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.958 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.958 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:19:45.958 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:19:46.897 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:19:46.898 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:19:49.277 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:19:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:19:49.432 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:19:50.399 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:19:50.400 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:19:52.786 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:19:53.115 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:53.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:53.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:53.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:53.202 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:19:53.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:53.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:19:53.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:19:53.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:19:53.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:19:53.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:19:53.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:19:53.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:19:53.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:19:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:19:54.049 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:19:54.050 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:19:56.639 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:19:57.135 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:19:57.542 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:19:58.011 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:19:58.011 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:19:59.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:19:59.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:19:59.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:19:59.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:19:59.970 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:19:59.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:20:00.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:20:00.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:20:00.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:20:00.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:20:00.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:20:00.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:20:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:20:00.818 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:20:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:02.311 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:02.311 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:20:03.032 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:20:04.546 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:20:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:06.391 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:06.391 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:20:06.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:20:06.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:20:06.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:20:07.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:20:07.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:20:07.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:20:07.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:20:07.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:20:07.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:20:07.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:20:07.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:20:07.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:20:07.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:20:07.359 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:20:09.106 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:10.251 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:10.251 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:20:10.432 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:20:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:20:13.574 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:14.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:20:14.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:20:14.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:20:14.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:20:14.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:14.344 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:20:14.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:20:14.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:20:14.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:20:14.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:20:14.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:20:14.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:20:14.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:20:14.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:20:14.558 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:20:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:20:15.159 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:20:17.399 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:20:17.558 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:18.329 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:18.329 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:20:18.585 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:20:21.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:20:21.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:20:21.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:20:21.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:20:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:20:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:20:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:20:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:20:21.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:20:21.536 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:21.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:20:21.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:20:21.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:20:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:20:21.623 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:20:22.380 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:22.381 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:20:24.623 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:20:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:20:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:26.307 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:26.308 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:20:27.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:20:27.175 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:20:27.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:20:27.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:20:27.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:20:27.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:20:27.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:20:27.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:20:27.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:20:27.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:20:27.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:20:27.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:20:27.445 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:20:27.957 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:20:29.480 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:30.204 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:30.205 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:20:30.357 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:20:31.547 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:34.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:20:34.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:20:34.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:20:34.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:20:34.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:20:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:20:34.402 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:34.403 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:20:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:20:34.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:20:34.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:20:34.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:20:34.575 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:20:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:20:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:20:34.769 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:20:37.406 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:20:37.472 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:38.298 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:38.299 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:20:38.455 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:20:40.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:20:40.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:20:40.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:20:40.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:20:40.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:20:40.746 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:20:40.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:20:40.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:20:40.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:20:40.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:20:40.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:20:40.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:20:40.954 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.954 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.954 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.954 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.955 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:20:40.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:20:41.205 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:20:41.529 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:42.228 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:42.229 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:20:43.672 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:20:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:20:45.729 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:46.486 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:46.486 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:20:46.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:20:46.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:20:46.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:20:46.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:20:46.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:20:46.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:20:46.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:20:47.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:20:47.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:20:47.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:20:47.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:20:47.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:20:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:20:47.573 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:20:49.307 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:49.933 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:49.934 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:20:50.039 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:20:50.549 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:20:52.743 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:53.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:20:53.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:20:53.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:20:53.373 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:53.373 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:20:53.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:20:53.388 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:20:53.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:20:53.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:20:53.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:20:53.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:20:53.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:20:53.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:20:53.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:20:53.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:20:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:20:53.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:20:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:56.752 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:20:56.753 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:20:56.879 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:20:57.582 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:20:59.622 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:20:59.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:20:59.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:20:59.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:20:59.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:20:59.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:00.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:00.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:00.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:00.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:00.117 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:00.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:00.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.172 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.173 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:21:00.392 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:21:00.393 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:21:00.811 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:21:02.805 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:21:03.137 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:21:03.576 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:21:03.987 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:21:03.988 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:21:06.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:21:06.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:21:06.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:21:06.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:21:06.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:06.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:06.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:06.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:06.488 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:21:06.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:06.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:06.534 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:21:06.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:21:07.284 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:21:07.285 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:21:09.581 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:21:09.875 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:21:09.875 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:21:09.875 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:21:09.875 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:21:10.558 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:21:10.724 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:21:12.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:21:12.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:21:12.857 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:21:12.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:21:12.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:12.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:12.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:12.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:13.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:13.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:13.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:13.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:13.099 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:21:13.354 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:21:13.755 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:21:14.549 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:21:15.724 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:21:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:21:17.405 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:21:18.119 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:21:18.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:21:18.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:21:18.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:21:18.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:21:18.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:18.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:18.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:18.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:18.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:18.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:18.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:19.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:19.028 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:21:19.575 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:21:20.850 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:21:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:21:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:21:20.851 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:21:21.774 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:21:21.919 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:21:22.736 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:21:24.883 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:21:24.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:21:24.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:21:24.975 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:21:25.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:25.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:25.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:25.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:25.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:25.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:25.189 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:21:25.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:25.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:25.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:21:25.550 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:21:25.964 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:21:28.149 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:21:28.593 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:21:29.427 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:21:29.483 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:21:30.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:21:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:21:30.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:21:30.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:21:31.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:31.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:31.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:31.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:31.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:31.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:31.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:31.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:31.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:21:31.210 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:21:32.337 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:21:32.446 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:21:32.446 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:21:32.446 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:21:32.446 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:21:33.143 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:21:33.776 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:21:36.008 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:21:36.009 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:21:36.009 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:21:36.009 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:21:36.009 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:21:36.478 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:21:36.665 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:21:37.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:21:37.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:21:37.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:21:37.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:21:37.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:37.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:37.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:37.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:37.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:37.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:37.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:37.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:21:39.248 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:21:39.351 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:21:39.984 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:21:40.445 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:21:42.566 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:21:42.678 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:21:43.513 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:21:44.075 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:21:44.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:21:44.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:21:44.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:21:44.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:44.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:44.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:44.293 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:44.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:44.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:44.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:44.398 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:44.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:21:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:21:45.353 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:21:45.835 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:21:45.835 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:21:45.835 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:21:45.836 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:21:45.836 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:21:46.658 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:21:47.313 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:21:48.500 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:21:49.768 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:21:49.768 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:21:49.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:21:49.768 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:21:49.769 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:21:50.396 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:21:50.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:21:50.699 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:21:50.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:21:50.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:21:50.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:50.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:50.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:50.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:50.887 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:50.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:50.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:50.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:50.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.979 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:21:50.979 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:21:51.459 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:21:52.905 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:21:53.804 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:21:53.804 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:21:54.102 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:21:54.576 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:21:56.808 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:21:57.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:21:57.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:21:57.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:21:57.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:21:57.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:21:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:21:57.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:21:57.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:21:57.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:21:57.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:21:57.512 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:21:57.513 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:21:57.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:21:57.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:21:57.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:21:57.678 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:22:00.147 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:22:00.760 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:01.477 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:01.477 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:22:01.565 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:22:03.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:03.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:03.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:03.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:03.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:03.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:03.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:03.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:03.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:03.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:03.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:03.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:03.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:22:03.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:22:04.475 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:22:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:05.149 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:05.150 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:22:05.968 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:22:08.385 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:22:09.052 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:09.053 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:22:09.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:09.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:09.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:09.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:09.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:09.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:09.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:09.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:09.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:09.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:09.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:09.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:09.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:22:09.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:22:11.561 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:22:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:12.171 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:22:12.187 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:12.188 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:22:15.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:15.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:15.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:15.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:15.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:15.453 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:15.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:15.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:15.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:15.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:15.578 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:15.609 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:15.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:22:15.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:22:16.360 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:16.361 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:22:18.464 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:18.515 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:22:19.141 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:19.142 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:22:21.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:21.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:21.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:21.579 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:21.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:21.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:21.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:21.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:22:21.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:22:22.333 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:22.334 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:22:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:24.529 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:22:25.117 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:25.118 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:22:25.247 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:22:27.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:27.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:27.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:27.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:27.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:27.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:27.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:27.793 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:27.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:27.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:27.887 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:22:27.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:22:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:22:28.158 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:29.203 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:29.204 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:22:30.789 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:22:32.066 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:32.968 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:32.969 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:22:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:33.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:33.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:33.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:33.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:33.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:33.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:33.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:33.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:33.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:22:33.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:22:35.264 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:35.959 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:35.959 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:22:36.648 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:22:38.660 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:39.327 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:39.328 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:22:39.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:39.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:39.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:39.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:39.875 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:39.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:39.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:39.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:39.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:40.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:40.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:40.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:22:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:22:41.625 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:22:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:42.844 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:42.845 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:22:43.064 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:22:44.692 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:22:45.487 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:46.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:46.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:46.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:46.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:46.326 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:46.326 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:22:46.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:46.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:46.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:46.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:46.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:46.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:46.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:46.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:22:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:22:48.520 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:22:49.203 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:49.467 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:22:49.744 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:49.744 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:22:51.324 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:22:52.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:52.041 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:52.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:52.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:52.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:52.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:52.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:52.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:52.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:52.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:52.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:52.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:52.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:22:52.375 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:53.617 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:53.617 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:22:54.607 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:22:55.152 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:22:56.026 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:22:56.727 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:22:56.728 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:22:57.440 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:22:57.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:22:57.942 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:22:57.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:22:57.988 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:22:58.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:22:58.041 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:22:58.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:22:58.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:22:58.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:22:58.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:22:58.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:22:58.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:22:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:22:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:22:59.541 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:23:00.428 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:23:00.429 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:23:00.974 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:23:01.646 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:23:03.232 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:23:03.898 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:23:03.899 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:23:04.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:23:04.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:23:04.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:23:04.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:23:04.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:23:04.435 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:23:04.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:23:04.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:23:04.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:23:04.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:23:04.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:23:04.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:23:04.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:23:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:23:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:23:06.685 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:23:07.342 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:23:07.343 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:23:07.451 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:23:08.597 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:23:10.301 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:23:10.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:23:10.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:23:10.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:23:10.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:23:10.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:23:10.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:23:10.482 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:23:10.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:23:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:23:10.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:23:10.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:23:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:23:10.595 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:23:11.556 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:23:11.577 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:23:11.577 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:23:13.410 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:23:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:23:14.996 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:23:15.706 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:23:15.706 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:23:16.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:23:16.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:23:16.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:23:16.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:23:16.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:23:16.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:23:16.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:23:16.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:23:16.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:23:16.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:23:16.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:23:16.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:23:16.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.872 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.873 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:23:16.874 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:23:18.026 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:23:18.111 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:23:18.697 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:23:19.672 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:23:21.591 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:23:21.710 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:23:22.363 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:23:23.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:23:23.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:23:23.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:23:23.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:23:23.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:23:23.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:23:23.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:23:23.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:23:23.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:23:23.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:23:23.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:23:23.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:23:23.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:23:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:23:24.611 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:23:24.916 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:23:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:23:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:23:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:23:24.917 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:23:25.784 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:23:26.306 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:23:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:23:29.074 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:23:29.074 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:23:29.074 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:23:29.074 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:23:29.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:23:29.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:23:29.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:23:29.399 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:23:29.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:23:29.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:23:29.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:23:29.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:23:29.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:23:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:23:29.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:23:29.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:23:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:23:29.804 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:23:30.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:23:32.251 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:23:32.628 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:23:33.496 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:23:33.561 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:23:35.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:23:35.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:23:35.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:23:35.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:23:35.357 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:23:35.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:23:35.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:23:35.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:23:35.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:23:35.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:23:35.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:23:35.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:23:35.579 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.579 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.580 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.580 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.580 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.580 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.580 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.580 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.580 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:23:35.581 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:23:36.555 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:23:36.723 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:23:36.723 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:23:36.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:23:36.724 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:23:36.724 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:23:37.400 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:23:38.305 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:23:39.600 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:23:40.959 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:23:40.959 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:23:40.959 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:23:40.959 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:23:41.740 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:23:41.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:23:41.867 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:23:41.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:23:41.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:23:41.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:23:41.971 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:23:41.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:23:42.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:23:42.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:23:42.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:23:42.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:23:42.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:23:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:23:42.395 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:23:44.377 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:23:44.808 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:23:45.047 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:23:46.603 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:23:47.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:23:47.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:23:47.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:23:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:23:47.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:23:47.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:23:47.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:23:47.982 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:23:48.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:23:48.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:23:48.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:23:48.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:23:48.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:23:48.114 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:23:48.115 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:23:48.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:23:48.115 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:23:48.115 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:23:49.071 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:23:49.543 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:23:50.891 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:23:52.002 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:23:52.003 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:23:52.003 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:23:52.003 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:23:52.940 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:23:53.626 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:23:53.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:23:53.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:23:53.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:23:53.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:23:53.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:23:53.942 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:23:53.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:23:53.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:23:54.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:23:54.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:23:54.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:23:54.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:23:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:23:54.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:23:55.977 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:23:56.474 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:23:56.598 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:23:57.110 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:24:00.056 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:24:00.610 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:24:00.702 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:24:02.890 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:03.286 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:24:03.526 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:03.527 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:24:06.022 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:06.605 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:24:06.648 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:06.649 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:24:08.981 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:09.092 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:24:09.630 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:09.630 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:24:10.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:24:10.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:24:10.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:24:10.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:24:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:24:10.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:24:10.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:24:10.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:24:10.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:24:10.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:24:10.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:24:10.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:24:10.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:24:10.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:24:12.631 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:13.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:13.258 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:24:13.922 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:24:15.897 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:16.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:24:16.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:24:16.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:24:16.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:16.680 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:24:16.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:24:16.718 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:24:16.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:24:16.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:24:16.802 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:24:16.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:24:16.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:24:16.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:24:16.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:24:16.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:24:16.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:24:19.001 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:19.538 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:19.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:24:19.605 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:24:21.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:24:21.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:24:21.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:24:22.010 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:24:22.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:24:22.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:24:22.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:24:22.117 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:24:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:22.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:24:22.170 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:24:22.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:24:22.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:24:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.227 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:24:22.602 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:24:22.894 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:22.895 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:24:25.166 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:24:25.267 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:25.409 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:24:25.954 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:25.954 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:24:28.828 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:24:29.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:24:29.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:24:29.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:24:29.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:24:29.174 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:29.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:24:29.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:24:29.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:24:29.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:24:29.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:24:29.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:24:29.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:24:29.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:24:29.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.448 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:24:29.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:24:30.212 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:30.213 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:24:31.889 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:24:32.305 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:32.420 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:24:33.106 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:33.107 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:24:36.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:24:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:24:36.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:24:36.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:24:36.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:24:36.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:24:36.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:24:36.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:24:36.246 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:24:36.252 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:36.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:24:36.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:24:36.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:24:36.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:24:36.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:24:36.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:24:37.266 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:37.266 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:24:38.967 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:24:39.285 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:39.462 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:24:40.209 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:40.210 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:24:43.097 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:24:43.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:24:43.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:24:43.258 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:43.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:24:43.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:24:43.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:24:43.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:24:43.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:24:43.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:24:43.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:24:43.489 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:24:43.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:24:43.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:24:43.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:24:43.572 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:24:44.345 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:44.346 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:24:46.009 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:24:46.334 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:46.500 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:24:47.278 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:47.278 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:24:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:24:50.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:24:50.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:24:50.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:24:50.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:24:50.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:24:50.308 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:24:50.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:24:50.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:24:50.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:24:50.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:24:50.499 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:24:50.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:24:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:24:50.728 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:51.516 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:51.516 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:24:52.169 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:24:53.084 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:24:54.436 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:55.352 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:55.352 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:24:56.515 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:24:56.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:24:56.566 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:24:56.589 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:24:56.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:24:56.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:24:56.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:24:56.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:24:56.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:24:56.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:24:56.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:24:56.867 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:24:56.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:24:56.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.899 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.899 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.899 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.899 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:24:56.900 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:24:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:24:59.038 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:24:59.038 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:24:59.583 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:24:59.853 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:25:02.375 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:25:03.265 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:25:03.438 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:25:03.439 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:25:03.891 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:25:03.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:25:03.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:25:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:25:04.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:25:04.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:25:04.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:25:04.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:25:04.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:25:04.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:25:04.226 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:25:04.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:25:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:25:04.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:25:05.948 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:25:05.996 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:25:06.687 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:25:06.687 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:25:06.977 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:25:09.686 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:25:10.342 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:25:10.343 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:25:10.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:25:10.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:25:10.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:25:10.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:25:10.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:25:10.482 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:25:10.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:25:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:25:10.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:25:10.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:25:10.621 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:25:10.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:25:10.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:25:10.648 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:25:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:25:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:25:13.419 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:25:13.419 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:25:13.595 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:25:13.958 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:25:16.776 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:25:16.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:25:16.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:25:17.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:25:17.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:25:17.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:25:17.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:25:17.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:25:17.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:25:17.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:25:17.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:25:17.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:25:17.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:25:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:25:17.521 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:25:17.522 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:25:18.637 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:25:19.948 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:25:19.953 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:25:20.597 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:25:20.598 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:25:21.541 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:25:23.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:25:23.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:25:23.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:25:23.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:25:23.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:25:23.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:25:23.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:25:23.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:25:23.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:25:23.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:25:23.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:25:23.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:25:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:25:23.582 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:25:24.701 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:25:24.702 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:25:25.288 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:25:26.338 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:25:27.155 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:25:27.970 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:25:28.030 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:25:28.870 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:25:28.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:25:28.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:25:28.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:25:28.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:25:29.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:25:29.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:25:29.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:25:29.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:25:29.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:25:29.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:25:29.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:25:29.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:25:29.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:25:31.258 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:25:31.258 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:25:31.258 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:25:31.258 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:25:31.258 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:25:31.599 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:25:31.859 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:25:31.996 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:25:34.332 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:25:34.715 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:25:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:25:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:25:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:25:34.716 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:25:34.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:25:34.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:25:34.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:25:34.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:25:35.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:25:35.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:25:35.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:25:35.106 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:25:35.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:25:35.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:25:35.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:25:35.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:25:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:25:35.533 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:25:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:25:38.393 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:25:38.477 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:25:38.980 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:25:40.420 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:25:41.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:25:41.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:25:41.247 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:25:41.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:25:41.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:25:41.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:25:41.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:25:41.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:25:41.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:25:41.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:25:41.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:25:41.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:25:41.519 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.520 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.520 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.520 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.520 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.520 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.520 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.521 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.521 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.521 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.521 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.521 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:25:41.579 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:25:41.579 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:25:41.579 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:25:41.579 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:25:41.579 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:25:42.844 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:25:43.576 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:25:44.571 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:25:45.294 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:25:45.295 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:25:45.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:25:45.295 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:25:45.295 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:25:46.068 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:25:46.420 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:25:48.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:25:48.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:25:48.093 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:25:48.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:25:48.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:25:48.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:25:48.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:25:48.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:25:48.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:25:48.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:25:48.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:25:48.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:25:48.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:25:48.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:25:49.274 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:25:49.904 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:25:50.617 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:25:51.158 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:25:52.967 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:25:53.519 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:25:53.646 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:25:53.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:25:53.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:25:53.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:25:53.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:25:54.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:25:54.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:25:54.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:25:54.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:25:54.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:25:54.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:25:54.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:25:54.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:25:54.210 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.210 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:25:54.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:25:56.349 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:25:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:25:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:25:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:25:56.349 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:25:57.029 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:25:57.075 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:25:57.671 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:25:59.946 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:25:59.946 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:25:59.946 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:25:59.946 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:26:00.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:26:00.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:26:00.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:26:00.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:26:00.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:26:00.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:26:00.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:26:00.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:26:00.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:26:00.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:26:00.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:26:00.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:26:00.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.528 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:26:00.568 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:26:00.787 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:26:03.153 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:26:03.182 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:26:03.804 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:26:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:26:06.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:26:06.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:26:06.368 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:26:06.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:26:06.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:26:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:26:06.489 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:26:06.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:26:06.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:26:06.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:26:06.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:26:06.606 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:26:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:26:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:26:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:26:06.607 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:26:06.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:26:06.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:26:06.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:26:07.390 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:26:07.557 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:26:09.568 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:26:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:10.627 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:26:11.031 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:11.032 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:26:12.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:26:12.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:26:12.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:26:12.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:26:12.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:26:12.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:26:12.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:26:12.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:26:12.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:26:12.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:26:13.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:26:13.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:26:13.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.035 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.035 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:26:13.332 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:26:13.715 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:14.396 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:14.396 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:26:15.717 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:26:16.750 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:26:17.212 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:18.408 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:18.409 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:26:18.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:26:18.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:26:18.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:26:18.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:26:18.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:26:18.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:26:18.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:26:18.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:26:19.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:26:19.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:26:19.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:26:19.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:26:19.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.093 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.093 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.093 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.093 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.093 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:26:19.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:26:20.141 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:26:20.758 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:21.494 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:21.494 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:26:21.966 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:26:23.410 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:26:24.617 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:25.269 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:25.269 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:26:25.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:26:25.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:26:25.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:26:25.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:26:25.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:26:25.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:26:25.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:26:25.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:26:25.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:26:25.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:26:26.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:26:26.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:26:26.031 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:26:26.298 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:26:27.762 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:28.620 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:28.621 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:26:28.826 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:26:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:26:31.684 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:31.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:26:31.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:26:31.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:26:31.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:26:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:26:31.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:26:31.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:26:31.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:26:32.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:26:32.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:26:32.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:26:32.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:26:32.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:26:32.294 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:32.294 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:26:32.434 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:26:34.797 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:26:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:35.673 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:35.673 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:26:36.645 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:26:38.363 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:39.007 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:39.008 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:26:39.408 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:26:41.550 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:42.191 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:42.191 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:26:42.683 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:26:44.422 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:45.050 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:45.051 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:26:45.325 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:26:47.634 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:48.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:26:48.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:26:48.205 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:48.206 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:26:48.228 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:26:48.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:26:48.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:26:48.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:26:48.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:26:48.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:26:48.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:26:48.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:26:48.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:26:48.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:26:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:26:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:26:50.634 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:51.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:51.259 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:26:51.402 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:26:51.619 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:26:54.375 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:54.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:26:54.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:26:54.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:26:54.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:26:54.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:26:54.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:26:54.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:26:54.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:26:54.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:26:55.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:26:55.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:26:55.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:26:55.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.085 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.085 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.085 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:26:55.628 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:55.628 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:26:56.636 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:26:57.773 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:26:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:26:58.771 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:26:58.772 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:26:59.540 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:27:00.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:00.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:00.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:00.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:00.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:00.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:00.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:00.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:00.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:00.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:00.911 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:00.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:00.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:27:00.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:27:02.592 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:27:03.208 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:27:03.209 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:27:03.473 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:27:03.824 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:27:06.255 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:27:06.286 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:27:06.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:06.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:06.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:06.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:06.922 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:27:06.922 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:27:06.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:06.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:07.010 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:07.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:07.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:07.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:07.115 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:07.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:27:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:27:09.806 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:27:10.065 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:27:10.414 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:27:10.415 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:27:10.640 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:27:12.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:13.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:13.047 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:13.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:13.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:13.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:13.200 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:27:13.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:13.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:13.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:13.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:13.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:13.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:13.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:27:13.535 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:27:14.076 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:27:14.076 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:27:16.350 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:27:16.659 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:27:17.020 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:27:17.470 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:27:17.471 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:27:19.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:19.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:19.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:19.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:19.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:19.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:19.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:19.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:19.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:19.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:19.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:19.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:19.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:27:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:27:20.353 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:27:20.429 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:27:21.041 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:27:21.042 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:27:22.020 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:27:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:27:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:27:24.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:25.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:25.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:25.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:25.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:25.124 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:27:25.124 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:27:25.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:25.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:25.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:25.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:25.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:25.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:25.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:27:25.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:27:27.574 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:27:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:27:28.115 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:27:28.663 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:27:28.664 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:27:31.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:31.568 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:31.592 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:31.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:31.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:31.662 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:27:31.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:31.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:31.726 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:31.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:31.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:27:31.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:31.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:27:31.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:27:32.921 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:27:32.921 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:27:34.558 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:27:34.991 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:27:34.991 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:27:34.991 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:27:34.992 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:27:35.108 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:27:35.706 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:27:38.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:38.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:38.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:38.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:38.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:38.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:38.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:38.699 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:27:38.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:38.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:38.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:38.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:38.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:27:38.825 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:27:40.018 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:27:41.511 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:27:41.831 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:27:42.201 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:27:43.056 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:27:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:27:45.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:45.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:45.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:45.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:45.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:45.870 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:45.897 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:45.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:45.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:45.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:46.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:46.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:46.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.068 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:27:46.327 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:27:46.328 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:27:46.328 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:27:46.328 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:27:47.141 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:27:47.764 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:27:48.770 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:27:50.025 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:27:50.025 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:27:50.026 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:27:50.026 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:27:50.026 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:27:50.664 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:27:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:27:53.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:53.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:53.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:53.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:53.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:53.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:53.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:53.235 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:27:53.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:53.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:53.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:53.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:53.381 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.381 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.381 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.381 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.382 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.382 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.382 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.382 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.382 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.382 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.382 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:27:53.708 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:27:55.273 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:27:55.866 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:27:56.138 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:27:56.623 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:27:59.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:27:59.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:27:59.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:27:59.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:27:59.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:27:59.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:27:59.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:27:59.723 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:27:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:27:59.738 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:27:59.738 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:27:59.738 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:27:59.738 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:27:59.738 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:27:59.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:27:59.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:27:59.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:27:59.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:27:59.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.839 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.839 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:27:59.839 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:28:01.007 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:28:02.569 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:28:03.013 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:28:03.219 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:28:03.219 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:28:03.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:28:03.219 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:28:03.219 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:28:04.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:28:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:28:06.733 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:28:06.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:28:06.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:28:06.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:28:06.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:28:06.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:28:06.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:28:06.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:28:06.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:28:06.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:28:06.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:28:07.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:28:07.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.021 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:28:07.297 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:28:08.161 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:28:09.422 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:28:09.976 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:28:10.258 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:28:11.168 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:28:13.350 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:28:13.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:28:13.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:28:13.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:28:13.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:28:13.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:28:13.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:28:13.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:28:13.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:28:13.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:28:13.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:28:13.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:28:13.982 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:28:13.984 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.984 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.984 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.985 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.986 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:28:13.986 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:28:14.451 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:28:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:28:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:28:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:28:14.451 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:28:15.130 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:28:16.200 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:28:16.733 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:28:17.852 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:18.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:18.738 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:28:20.398 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:28:20.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:28:20.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:28:20.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:28:20.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:28:20.967 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:28:20.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:28:21.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:28:21.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:28:21.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:28:21.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:28:21.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:28:21.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:28:21.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:28:21.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:28:22.159 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:22.752 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:22.752 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:28:23.243 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:28:23.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:28:25.479 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:26.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:26.462 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:28:27.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:28:27.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:28:27.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:28:27.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:28:27.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:28:27.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:28:27.308 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:28:27.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:28:27.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:28:27.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:28:27.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:28:27.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:28:27.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:28:27.694 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:28:29.238 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:29.845 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:29.846 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:28:30.502 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:28:30.746 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:28:32.986 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:34.115 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:34.115 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:28:34.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:28:34.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:28:34.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:28:34.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:28:34.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:28:34.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:28:34.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:28:34.293 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:28:34.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:28:34.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:28:34.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:28:34.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:28:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:28:34.655 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:28:36.635 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:37.281 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:37.281 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:28:37.368 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:28:37.758 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:28:40.488 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:40.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:28:40.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:28:40.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:28:40.863 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:28:40.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:28:40.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:28:40.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:28:40.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:28:40.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:28:41.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:28:41.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:28:41.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:28:41.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:28:41.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:41.358 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:28:41.760 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:28:43.773 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:28:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:44.489 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:28:44.517 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:44.517 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:28:47.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:28:47.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:28:47.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:28:47.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:28:47.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:28:47.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:28:47.715 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:47.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:28:47.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:28:47.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:28:47.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:28:47.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:28:47.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:28:47.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:28:47.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:28:48.279 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:48.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:28:48.708 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:28:50.555 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:50.656 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:28:51.244 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:51.245 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:28:51.538 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:28:53.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:28:53.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:28:53.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:28:53.780 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:28:53.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:28:53.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:28:53.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:28:53.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:28:53.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:28:54.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:28:54.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:28:54.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:28:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:28:54.246 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:55.008 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:55.008 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:28:55.700 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:28:57.191 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:28:57.359 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:28:58.005 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:28:58.005 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:28:58.499 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:29:00.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:00.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:00.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:00.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:00.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:00.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:00.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:00.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:00.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:00.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:00.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:00.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:00.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:29:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:29:01.580 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:02.355 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:02.356 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:29:03.520 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:29:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:05.404 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:05.405 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:29:06.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:06.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:06.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:06.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:06.117 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:06.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:06.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:06.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:06.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:06.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:06.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:06.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.325 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.325 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:29:06.325 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:29:07.636 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:08.159 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:08.160 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:29:09.130 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:29:10.394 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:11.269 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:11.270 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:29:11.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:11.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:11.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:11.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:11.897 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:11.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:11.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:11.982 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:12.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:12.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:12.075 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:12.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:29:12.706 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:29:13.884 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:14.491 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:14.491 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:29:15.017 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:29:15.497 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:29:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:18.355 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:18.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:18.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:18.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:18.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:18.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:18.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:18.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:18.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:18.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:18.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:18.599 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:18.599 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:29:18.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:18.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:29:18.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:29:19.732 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:29:21.237 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:29:21.371 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:22.066 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:22.067 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:29:22.499 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:29:25.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:25.048 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:25.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:25.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:25.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:25.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:25.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:25.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:25.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:25.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:25.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:25.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:29:25.761 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:25.761 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:29:27.042 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:29:28.334 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:29:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:29.076 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:29.076 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:29:29.928 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:29:31.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:31.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:31.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:31.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:31.499 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:31.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:31.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:31.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:31.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:31.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:31.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:31.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:31.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:29:31.689 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:29:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:33.114 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:33.114 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:29:33.705 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:29:34.565 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:29:35.349 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:36.027 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:36.027 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:29:36.782 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:29:37.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:37.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:37.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:37.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:37.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:37.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:37.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:37.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:37.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:37.522 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:37.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:37.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:29:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:29:39.213 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:29:40.062 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:29:40.062 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:29:40.514 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:29:40.804 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:29:43.073 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:29:43.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:43.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:43.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:43.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:43.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:43.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:43.602 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:43.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:43.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:43.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:43.730 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:43.766 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:29:43.783 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:29:43.969 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:29:46.366 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:29:46.483 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:29:46.483 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:29:46.483 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:29:46.483 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:29:46.483 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:29:47.135 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:29:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:29:49.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:49.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:49.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:49.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:49.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:49.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:49.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:49.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:49.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:49.863 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:29:49.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:49.891 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:49.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:49.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:29:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:29:50.644 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:29:50.715 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:29:52.797 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:29:53.462 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:29:53.522 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:29:54.573 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:29:56.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:29:56.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:29:56.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:29:56.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:29:56.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:29:56.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:29:56.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:29:56.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:29:56.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:29:56.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:29:56.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:29:56.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:29:56.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.180 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.180 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:29:56.392 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:29:57.507 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:29:57.508 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:29:57.508 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:29:57.508 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:29:57.508 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:29:58.406 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:29:58.766 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:29:59.505 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:30:01.474 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:30:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:30:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:30:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:30:01.475 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:30:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:01.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:01.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:01.798 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:01.824 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:01.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:01.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:01.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:01.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:01.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:01.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:02.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:02.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:30:02.193 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:30:02.634 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:30:04.576 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:30:04.894 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:30:05.292 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:30:05.719 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:30:07.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:07.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:07.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:07.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:07.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:07.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:07.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:07.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:07.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:08.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:08.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:08.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:30:08.356 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:30:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:30:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:30:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:30:08.357 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:30:08.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:30:09.262 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:30:10.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:30:11.753 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:30:12.416 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:30:12.416 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:30:12.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:30:12.417 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:30:12.417 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:30:13.288 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:30:13.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:13.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:13.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:13.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:13.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:13.844 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:13.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:13.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:13.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:13.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:14.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:14.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:30:14.965 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:30:15.725 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:30:16.435 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:30:16.885 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:30:18.760 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:30:19.374 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:30:20.197 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:30:20.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:20.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:20.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:20.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:20.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:20.745 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:20.777 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:20.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:20.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:20.857 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:20.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:20.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:20.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:30:20.913 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:30:21.943 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:30:22.672 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:30:22.672 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:30:22.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:30:22.673 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:30:22.673 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:30:23.292 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:30:23.844 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:30:25.345 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:30:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:26.716 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:26.716 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:30:27.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:27.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:27.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:27.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:27.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:27.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:27.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:27.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:27.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:27.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:27.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:27.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:30:27.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:30:28.162 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:30:29.295 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:30.275 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:30.276 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:30:30.541 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:30:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:30:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:33.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:33.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:33.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:33.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:33.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:33.733 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:33.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:33.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:33.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:30:33.940 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:33.940 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:30:34.754 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:30:36.393 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:30:36.611 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:37.282 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:37.282 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:30:38.587 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:30:39.308 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:39.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:39.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:39.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:39.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:39.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:39.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:39.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:39.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:39.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:39.579 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:39.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:39.607 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.607 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.607 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.607 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.608 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:30:39.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:30:40.609 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:41.255 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:41.255 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:30:41.508 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:30:42.230 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:30:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:44.969 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:44.970 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:30:45.454 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:30:45.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:45.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:45.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:45.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:45.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:45.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:45.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:45.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:45.733 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:45.761 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:45.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:45.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:45.839 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:30:45.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:30:47.538 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:48.152 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:48.153 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:30:48.292 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:30:48.972 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:30:51.325 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:52.152 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:52.153 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:30:52.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:52.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:52.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:52.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:52.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:52.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:52.575 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:52.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:52.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:52.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:52.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:52.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:52.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:30:52.756 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:30:54.729 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:55.365 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:55.365 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:30:55.457 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:30:55.816 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:30:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:30:59.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:30:59.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:30:59.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:30:59.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:30:59.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:30:59.246 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:30:59.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:30:59.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:30:59.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:30:59.332 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:30:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:30:59.335 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:31:00.776 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:31:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:02.058 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:31:02.674 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:02.674 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:31:03.558 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:31:05.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:31:05.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:31:05.676 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:31:05.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:31:05.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:31:05.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:31:05.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:31:05.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:31:05.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:31:05.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:31:05.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:31:06.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:31:06.007 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.009 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.009 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.009 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.009 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.009 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:31:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:07.065 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:07.065 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:31:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:31:08.814 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:31:09.456 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:10.205 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:10.205 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:31:10.300 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:31:11.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:31:11.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:31:11.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:31:11.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:31:11.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:31:12.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:31:12.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:31:12.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:31:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:31:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:31:13.624 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:13.765 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:31:14.480 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:14.481 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:31:14.981 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:31:16.697 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:31:16.980 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:17.848 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:17.848 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:31:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:31:17.988 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:31:18.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:31:18.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:31:18.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:31:18.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:31:18.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:31:18.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:31:18.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:31:18.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:31:18.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:31:18.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:31:18.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:31:18.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:31:20.826 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:31:20.831 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:21.503 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:31:21.731 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:21.731 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:31:23.564 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:31:24.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:31:24.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:31:24.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:31:24.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:31:24.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:31:24.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:31:24.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:31:24.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:31:24.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:31:24.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:31:24.316 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:31:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:31:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:31:25.025 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:25.026 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:31:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:27.699 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:31:27.901 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:31:28.387 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:28.388 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:31:30.699 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:31:30.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:31:31.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:31:31.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:31:31.060 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:31.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:31:31.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:31:31.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:31:31.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:31:31.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:31:31.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:31:31.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:31:31.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:31:31.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:31:31.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.321 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.321 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.321 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.321 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.321 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.321 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:31:31.838 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:31.839 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:31:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:31:34.573 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:31:34.774 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:35.601 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:35.601 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:31:36.237 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:31:38.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:31:38.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:31:38.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:31:38.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:31:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:31:38.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:31:38.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:31:38.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:31:38.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:31:38.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:31:38.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:31:38.568 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:31:38.568 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.568 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.568 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.568 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:31:38.696 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:39.549 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:39.550 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:31:39.793 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:31:41.385 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:31:42.082 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:42.537 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:31:42.970 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:42.970 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:31:44.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:31:44.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:31:44.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:31:44.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:31:44.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:31:44.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:31:44.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:31:44.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:31:44.991 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.991 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:31:44.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:31:46.123 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:46.750 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:46.751 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:31:46.840 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:31:47.815 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:31:49.367 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:31:49.574 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:31:50.524 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:31:50.525 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:31:50.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:31:50.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:31:50.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:31:50.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:31:50.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:31:50.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:31:51.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:31:51.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:31:51.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:31:51.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:31:51.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:31:51.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:31:51.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:31:51.162 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:31:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:31:53.951 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:31:53.951 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:31:53.951 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:31:53.952 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:31:53.958 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:31:54.707 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:31:55.488 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:31:57.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:31:57.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:31:57.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:31:57.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:31:57.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:31:57.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:31:57.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:31:57.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:31:57.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:31:57.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:31:57.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:31:57.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:31:57.666 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.666 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.666 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:31:57.838 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:31:58.822 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:31:59.789 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:32:00.554 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:32:01.299 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:32:02.185 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:32:02.619 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:32:03.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:32:03.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:32:03.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:32:03.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:32:03.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:32:03.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:32:03.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:32:03.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:32:03.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:32:03.685 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:32:03.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:32:03.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:32:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:32:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:32:05.254 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:32:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:32:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:32:05.254 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:32:05.864 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:32:06.488 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:32:06.789 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:32:09.638 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:32:09.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:32:09.718 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:32:09.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:32:09.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:32:09.797 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:32:09.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:32:09.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:32:09.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.853 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.853 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:32:09.868 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:32:12.188 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:32:12.869 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:32:13.303 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:32:13.393 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:32:15.531 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:32:16.017 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:32:16.210 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:32:16.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:32:16.609 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:32:16.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:32:16.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:32:16.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:32:16.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:32:16.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:32:16.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:32:16.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:32:16.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:32:16.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:32:16.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:32:16.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.882 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:32:16.882 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:32:18.819 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:32:18.820 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:32:18.820 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:32:18.820 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:32:18.820 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:32:19.472 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:32:19.716 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:32:20.083 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:32:22.409 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:32:22.409 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:32:22.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:32:22.409 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:32:22.409 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:32:22.450 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:32:23.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:32:23.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:32:23.063 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:32:23.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:32:23.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:32:23.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:32:23.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:32:23.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:32:23.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:32:23.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:32:23.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:32:23.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:32:23.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:32:23.318 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:32:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:32:25.669 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:32:26.206 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:32:26.367 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:32:26.711 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:32:28.922 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:32:29.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:32:29.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:32:29.563 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:32:29.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:32:29.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:32:29.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:32:29.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:32:29.673 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:32:29.699 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:32:29.710 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:32:29.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:32:29.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:32:29.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:32:29.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:32:29.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:32:29.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:32:32.565 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:32:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:32:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:32:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:32:32.566 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:32:32.738 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:32:33.086 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:32:33.227 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:32:35.928 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:32:35.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:32:35.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:32:35.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:32:36.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:32:36.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:32:36.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:32:36.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:32:36.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:32:36.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:32:36.211 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:32:36.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:32:36.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:32:37.500 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:32:37.500 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:32:39.304 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:32:39.645 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:32:40.273 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:32:40.468 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:32:40.469 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:32:42.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:32:42.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:32:42.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:32:42.130 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:32:42.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:32:42.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:32:42.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:32:42.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:32:42.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:32:42.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:32:42.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:32:42.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:32:42.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:32:42.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:32:43.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:32:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:32:44.294 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:32:44.295 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:32:45.162 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:32:45.738 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:32:47.579 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:32:48.276 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:32:48.276 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:32:48.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:32:48.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:32:48.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:32:48.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:32:48.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:32:48.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:32:48.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:32:48.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:32:48.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:32:48.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:32:48.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:32:48.685 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:32:48.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:32:48.839 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:32:51.059 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:32:51.398 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:32:51.832 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:32:51.833 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:32:52.818 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:32:54.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:32:54.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:32:54.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:32:54.438 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:32:54.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:32:54.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:32:54.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:32:54.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:32:54.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:32:54.592 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:32:54.609 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:32:54.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:32:54.693 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:32:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:32:54.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:32:55.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:32:55.433 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:32:55.557 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:32:57.607 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:32:57.969 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:32:58.855 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:32:58.856 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:32:59.874 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:33:00.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:00.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:00.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:00.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:00.893 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:00.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:00.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:00.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:00.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:01.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:01.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:33:01.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:33:02.132 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:02.726 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:02.727 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:33:02.894 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:33:03.830 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:33:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:06.818 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:33:06.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:06.836 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:33:07.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:07.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:07.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:07.441 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:07.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:07.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:07.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:07.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:07.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:07.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:07.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:07.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:07.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.727 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.728 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.728 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.728 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.728 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.728 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:33:07.728 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:33:09.433 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:09.471 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:33:10.225 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:10.225 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:33:10.391 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:33:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:33:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:14.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:14.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:14.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:14.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:14.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:14.294 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:14.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:14.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:14.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:14.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:33:14.509 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:14.509 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:33:15.684 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:33:16.756 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:16.862 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:33:17.610 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:17.610 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:33:18.858 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:33:20.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:20.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:20.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:20.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:20.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:20.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:20.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:20.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:20.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:20.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:20.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:20.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:20.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:33:20.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:33:21.477 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:21.478 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:33:21.698 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:33:23.638 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:33:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:24.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:24.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:33:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:33:26.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:26.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:26.555 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:26.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:26.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:26.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:26.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:26.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:26.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:26.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:26.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:26.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:26.789 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.789 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.789 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.791 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.791 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:33:26.791 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:33:27.812 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:33:27.937 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:28.723 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:28.724 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:33:29.388 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:33:31.775 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:31.834 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:33:32.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:32.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:32.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:32.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:32.593 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:32.594 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:33:32.599 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:32.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:32.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:32.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:33:32.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:33:34.742 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:33:34.946 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:35.180 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:33:35.705 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:35.705 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:33:38.836 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:33:38.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:39.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:39.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:39.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:39.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:39.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:39.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:39.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:33:39.347 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:40.226 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:40.226 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:33:41.507 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:33:42.054 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:33:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:43.270 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:43.270 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:33:45.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:45.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:45.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:45.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:45.734 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:45.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:45.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:45.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:45.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:45.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:45.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:45.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:45.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:33:45.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:33:46.451 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:46.839 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:33:47.064 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:47.064 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:33:48.580 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:33:49.262 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:49.493 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:33:49.997 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:49.997 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:33:51.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:52.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:52.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:52.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:52.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:52.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:52.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:52.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:52.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:52.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:52.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:52.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:52.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:33:52.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:33:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:53.850 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:33:54.237 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:54.238 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:33:55.104 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:33:56.710 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:33:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:33:58.004 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:33:58.004 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:33:58.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:33:58.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:33:58.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:33:58.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:33:58.612 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:33:58.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:33:58.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:33:58.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:33:58.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:33:58.748 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:33:58.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:33:58.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:33:58.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.804 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:33:58.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:34:00.800 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:34:00.889 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:34:01.521 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:34:01.521 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:34:01.724 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:34:03.764 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:34:04.129 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:34:04.129 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:34:04.129 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:34:04.129 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:34:04.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:34:04.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:34:04.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:34:04.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:34:04.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:34:04.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:34:04.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:34:04.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:34:04.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:34:04.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:34:04.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:34:04.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:34:04.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:34:04.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:34:05.008 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:34:06.940 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:34:07.858 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:34:08.108 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:34:08.929 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:34:09.518 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:34:11.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:34:11.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:34:11.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:34:11.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:34:11.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:34:11.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:34:12.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:34:12.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:34:12.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:34:12.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:34:12.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:34:12.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:34:12.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:34:12.168 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:34:12.168 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:34:12.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:34:12.168 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:34:12.168 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:34:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:34:13.173 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:34:14.973 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:34:15.314 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:34:15.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:34:15.314 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:34:15.315 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:34:15.541 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:34:16.312 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:34:18.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:34:18.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:34:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:34:18.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:34:18.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:34:18.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:34:18.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:34:18.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:34:18.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:34:18.453 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:34:18.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:34:18.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:34:18.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:34:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:34:19.739 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:34:19.774 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:34:20.686 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:34:21.211 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:34:22.523 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:34:23.254 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:34:24.123 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:34:24.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:34:24.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:34:24.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:34:24.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:34:24.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:34:24.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:34:24.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:34:24.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:34:24.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:34:24.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:34:24.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:34:24.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:34:24.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:34:24.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:34:26.874 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:34:26.875 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:34:26.875 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:34:26.875 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:34:27.115 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:34:27.536 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:34:28.019 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:34:29.971 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:34:30.220 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:34:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:34:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:34:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:34:30.221 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:34:30.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:34:30.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:34:30.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:34:30.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:34:30.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:34:30.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:34:30.757 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:34:30.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:34:30.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:34:30.840 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:34:30.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:34:30.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:34:30.891 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.891 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.891 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.891 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:34:30.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:34:31.109 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:34:33.588 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:34:33.597 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:34:34.296 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:34:35.018 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:34:36.298 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:34:36.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:34:36.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:34:36.967 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:34:36.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:34:37.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:34:37.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:34:37.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:34:37.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:34:37.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:34:37.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:34:37.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:34:37.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:34:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:34:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:34:38.556 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:34:38.556 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:34:38.556 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:34:38.556 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:34:39.276 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:34:39.753 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:34:40.051 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:34:42.053 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:34:42.053 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:34:42.053 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:34:42.053 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:34:42.054 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:34:42.478 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:34:42.814 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:34:43.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:34:43.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:34:43.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:34:43.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:34:43.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:34:43.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:34:43.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:34:43.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:34:43.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:34:43.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:34:43.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:34:43.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:34:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:34:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:34:45.541 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:34:45.613 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:34:46.562 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:34:46.567 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:34:48.373 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:34:49.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:34:49.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:34:49.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:34:49.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:34:49.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:34:49.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:34:49.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:34:49.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:34:49.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:34:49.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:34:49.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:34:49.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:34:49.529 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.529 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:34:49.762 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:34:50.956 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:34:50.957 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:34:51.881 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:34:52.508 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:34:53.618 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:34:54.585 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:34:54.585 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:34:54.794 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:34:54.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:34:55.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:34:55.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:34:55.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:34:55.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:34:55.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:34:55.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:34:55.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:34:55.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:34:55.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:34:55.255 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:34:55.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:34:55.282 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:34:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:34:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:34:58.067 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:34:58.192 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:34:58.193 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:34:58.682 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:35:00.778 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:35:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:01.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:01.368 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:01.408 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:01.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:01.458 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:01.459 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:35:01.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:01.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:01.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:01.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:01.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:01.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:01.635 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:01.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:01.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.664 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.664 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.664 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.664 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.664 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:35:01.664 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:35:04.296 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:04.521 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:35:04.940 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:04.941 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:35:05.119 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:35:07.400 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:07.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:07.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:07.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:07.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:07.533 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:07.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:07.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:07.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:07.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:07.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:07.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:35:07.852 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:07.880 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:35:08.909 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:08.909 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:35:10.591 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:35:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:35:12.167 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:12.168 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:35:13.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:13.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:13.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:13.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:13.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:13.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:13.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:13.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:13.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:13.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:13.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:13.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:13.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:35:13.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:35:14.870 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:35:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:15.922 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:15.922 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:35:16.653 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:35:18.701 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:18.756 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:35:19.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:19.347 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:35:20.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:20.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:20.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:20.264 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:20.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:20.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:20.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:20.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:20.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:20.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:20.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:20.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:20.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:35:20.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:35:21.680 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:35:22.010 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:22.849 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:22.850 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:35:23.393 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:35:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:35:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:26.318 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:26.319 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:35:26.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:27.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:27.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:27.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:27.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:27.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:27.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:27.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:27.246 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:27.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:27.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:27.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:35:27.748 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:35:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:29.799 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:29.799 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:35:30.180 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:35:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:35:32.807 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:32.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:32.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:33.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:33.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:33.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:33.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:33.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:33.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:33.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:33.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:33.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:35:33.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:33.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:35:33.674 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:35:35.821 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:35:36.077 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:36.874 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:36.875 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:35:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:35:39.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:39.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:39.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:39.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:39.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:39.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:39.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:39.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:39.308 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:39.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:39.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:39.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:39.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.392 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:35:39.715 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:35:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:40.717 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:40.717 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:35:42.027 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:35:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:35:43.727 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:44.417 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:44.417 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:35:45.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:45.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:45.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:45.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:45.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:45.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:45.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:45.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:45.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:45.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:45.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:45.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:35:45.874 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:35:46.681 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:47.487 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:47.488 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:35:48.088 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:35:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:35:50.565 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:51.161 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:51.161 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:35:51.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:51.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:51.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:51.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:51.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:51.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:51.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:51.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:51.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:51.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:51.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:51.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:51.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.534 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.535 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.536 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.536 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:35:51.846 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:35:53.665 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:54.257 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:54.257 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:35:54.273 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:35:54.849 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:35:57.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:35:57.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:35:57.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:35:57.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:35:57.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:35:57.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:35:57.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:35:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:35:57.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:35:57.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:35:57.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:35:57.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:35:57.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:35:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:35:57.694 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:35:58.042 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:35:58.043 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:36:00.247 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:36:00.720 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:36:01.293 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:36:01.436 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:36:01.437 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:36:03.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:36:03.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:36:03.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:36:03.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:36:03.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:36:03.463 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:36:03.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:36:03.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:36:03.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:36:03.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:36:03.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:36:03.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:36:03.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:36:03.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:36:04.175 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:36:04.302 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:36:04.757 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:36:04.758 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:36:06.311 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:36:07.235 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:36:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:36:07.999 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:36:08.000 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:36:09.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:36:09.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:36:09.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:36:10.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:36:10.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:36:10.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:36:10.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:36:10.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:36:10.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:36:10.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:36:10.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:36:10.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:36:10.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:36:10.637 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:36:10.860 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:36:11.406 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:36:11.407 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:36:13.007 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:36:14.089 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:36:14.760 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:36:14.974 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:36:15.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:36:15.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:36:15.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:36:16.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:36:16.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:36:16.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:36:16.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:36:16.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:36:16.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:36:16.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:36:16.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:36:16.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:36:16.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:36:16.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:36:17.545 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:36:17.771 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:36:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:36:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:36:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:36:17.771 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:36:18.555 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:36:19.146 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:36:21.691 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:36:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:36:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:36:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:36:21.692 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:36:21.762 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:36:21.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:36:21.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:36:22.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:36:22.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:36:22.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:36:22.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:36:22.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:36:22.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:36:22.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:36:22.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:36:22.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:36:22.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:36:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:36:22.516 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:36:24.908 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:36:25.039 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:36:25.080 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:36:25.712 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:36:28.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:36:28.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:36:28.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:36:28.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:36:28.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:36:28.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:36:28.581 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:36:28.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:36:28.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:36:28.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:36:28.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:36:28.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:36:28.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:36:28.925 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:36:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:36:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:36:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:36:28.925 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:36:28.929 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:36:29.942 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:36:31.619 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:36:31.976 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:36:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:36:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:36:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:36:31.977 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:36:32.107 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:36:32.838 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:36:34.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:36:34.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:36:35.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:36:35.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:36:35.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:36:35.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:36:35.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:36:35.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:36:35.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:36:35.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:36:35.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:36:35.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:36:35.290 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.290 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.290 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:36:35.999 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:36:36.020 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:36:36.688 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:36:38.049 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:36:38.858 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:36:39.037 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:36:39.902 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:36:42.737 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:36:43.051 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:36:43.359 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:36:45.574 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:36:45.778 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:36:46.315 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:36:48.937 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:36:48.983 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:36:49.915 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:36:51.733 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:36:52.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:36:52.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:36:52.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:36:52.117 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:36:52.117 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:36:52.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:36:52.117 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:36:52.118 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:36:52.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:36:52.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:36:52.175 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:36:52.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:36:52.228 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:36:52.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:36:52.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:36:52.308 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:36:52.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:36:52.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:36:52.911 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:36:55.028 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:36:55.561 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:36:55.772 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:36:56.127 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:36:56.128 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:36:57.780 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:36:58.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:36:58.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:36:58.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:36:58.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:36:58.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:36:58.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:36:58.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:36:58.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:36:58.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:36:58.564 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:36:58.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:36:58.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:36:58.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:36:58.653 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:36:58.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:36:59.343 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:36:59.343 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:37:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:02.081 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:37:02.088 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:37:02.878 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:02.878 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:37:05.128 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:37:05.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:37:05.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:37:05.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:37:05.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:37:05.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:37:05.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:37:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:05.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:37:05.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:37:05.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:37:05.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:37:05.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:37:05.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:37:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.642 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.642 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.642 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.642 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.642 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.642 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.642 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:37:05.643 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:37:06.328 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:06.328 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:37:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:37:08.814 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:37:09.483 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:10.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:10.139 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:37:11.179 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:37:12.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:37:12.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:37:12.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:37:12.106 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:37:12.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:37:12.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:37:12.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:37:12.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:37:12.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:37:12.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:37:12.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:37:12.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:37:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:37:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:37:13.141 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:13.862 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:13.863 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:37:14.767 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:37:15.368 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:37:16.714 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:17.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:17.503 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:37:17.750 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:37:18.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:37:18.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:37:18.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:37:18.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:37:18.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:37:18.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:37:18.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:37:18.368 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:37:18.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:37:18.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:37:18.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:37:18.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:37:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:37:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:37:20.414 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:21.100 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:21.101 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:37:21.689 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:37:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:37:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:24.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:37:24.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:37:24.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:37:24.754 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:24.755 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:37:24.773 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:37:24.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:37:24.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:37:24.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:37:24.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:37:24.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:37:24.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:37:24.980 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:37:24.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:37:25.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:37:25.013 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.013 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.013 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.013 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.013 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.013 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.013 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:37:25.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:37:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:27.801 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:37:28.277 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:28.277 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:37:28.975 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:37:30.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:37:30.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:37:30.891 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:37:30.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:37:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:37:30.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:37:31.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:37:31.016 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:31.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:37:31.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:37:31.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:37:31.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:37:31.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:37:31.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.162 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.162 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:37:31.573 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:31.573 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:37:32.041 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:37:33.978 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:37:34.233 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:34.780 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:37:35.073 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:35.073 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:37:37.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:37:37.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:37:37.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:37:37.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:37:37.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:37:37.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:37:37.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:37:37.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:37:37.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:37:37.357 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:37:37.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:37:37.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:37:37.412 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.412 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.412 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.412 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.412 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.412 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.413 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.413 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.413 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.413 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.413 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.413 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:37:37.612 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:37:37.965 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:38.635 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:38.635 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:37:40.109 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:37:41.093 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:41.714 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:41.715 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:37:41.959 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:37:43.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:37:43.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:37:43.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:37:43.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:37:43.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:37:43.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:37:43.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:37:43.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:37:43.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:37:43.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:37:43.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:37:43.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:37:43.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.951 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:37:43.951 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:37:44.543 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:44.738 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:37:45.084 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:45.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:37:46.656 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:37:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:37:48.984 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:48.984 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:37:49.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:37:49.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:37:49.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:37:49.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:37:49.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:37:49.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:37:49.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:37:49.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:37:49.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:37:49.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:37:50.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:37:50.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:37:50.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:37:50.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:37:51.215 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:37:51.388 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:52.177 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:52.177 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:37:52.937 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:37:54.774 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:37:55.191 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:56.098 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:56.099 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:37:56.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:37:56.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:37:56.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:37:56.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:37:56.602 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:37:56.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:37:56.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:37:56.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:37:56.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:37:56.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:37:56.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:37:56.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:37:56.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:37:56.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:37:57.848 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:37:58.680 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:37:59.352 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:37:59.353 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:37:59.760 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:38:01.788 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:38:02.144 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:38:03.054 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:38:03.054 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:38:03.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:38:03.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:38:03.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:38:03.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:38:03.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:38:03.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:38:03.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:38:03.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:38:03.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:38:03.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:38:03.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:38:03.773 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:38:03.775 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.777 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.777 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.777 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.777 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:38:03.777 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:38:04.743 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:38:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:38:06.333 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:38:06.333 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:38:06.699 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:38:07.990 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:38:09.428 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:38:09.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:38:09.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:38:09.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:38:09.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:38:09.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:38:09.733 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:38:09.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:38:09.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:38:09.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:38:09.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:38:09.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:38:09.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:38:09.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.894 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:38:09.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:38:10.165 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:38:10.165 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:38:10.947 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:38:12.593 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:38:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:38:14.062 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:38:14.063 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:38:14.786 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:38:16.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:38:16.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:38:16.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:38:16.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:38:16.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:38:16.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:38:16.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:38:16.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:38:16.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:38:16.398 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:38:16.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:38:16.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:38:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:38:16.960 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:38:17.477 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:38:17.478 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:38:17.667 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:38:19.097 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:38:20.480 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:38:21.538 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:38:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:38:22.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:38:22.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:38:22.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:38:22.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:38:22.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:38:22.247 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:38:22.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:38:22.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:38:22.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:38:22.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:38:22.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:38:22.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:38:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:38:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:38:24.230 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:38:24.230 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:38:24.230 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:38:24.230 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:38:24.231 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:38:24.794 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:38:24.907 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:38:25.331 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:38:28.322 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:38:28.451 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:38:28.452 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:38:28.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:38:28.452 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:38:28.452 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:38:28.574 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:38:28.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:38:28.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:38:28.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:38:28.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:38:28.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:38:28.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:38:28.761 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:38:28.802 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:38:28.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:38:28.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:38:28.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:38:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:38:28.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:38:29.569 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:38:31.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:38:31.734 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:38:31.777 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:38:32.569 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:38:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:38:35.900 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:38:35.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:38:35.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:38:36.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:38:36.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:38:36.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:38:36.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:38:36.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:38:36.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:38:36.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:38:36.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:38:36.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:38:36.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:38:36.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:38:36.550 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:38:37.589 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:38:38.932 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:38:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:38:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:38:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:38:38.932 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:38:38.992 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:38:40.044 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:38:42.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:38:42.101 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:38:42.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:38:42.170 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:38:42.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:38:42.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:38:42.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:38:42.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:38:42.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:38:42.342 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:38:42.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:38:42.396 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:38:42.423 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:38:42.425 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.425 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.425 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.425 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.426 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.426 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.426 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.426 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.426 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.426 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.426 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:38:42.427 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:38:43.152 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:38:43.686 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:38:44.771 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:38:45.184 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:38:46.001 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:38:47.077 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:38:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:38:48.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:38:48.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:38:48.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:38:48.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:38:48.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:38:48.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:38:48.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:38:48.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:38:48.685 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:38:48.726 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:38:48.761 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:38:48.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:38:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:38:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:38:50.208 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:38:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:38:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:38:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:38:50.209 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:38:50.901 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:38:51.412 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:38:51.713 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:38:54.448 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:38:54.448 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:38:54.448 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:38:54.448 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:38:54.795 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:38:54.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:38:55.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:38:55.048 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:38:55.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:38:55.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:38:55.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:38:55.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:38:55.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:38:55.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:38:55.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:38:55.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:38:55.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:38:55.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:38:55.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:38:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:38:57.545 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:38:57.661 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:38:58.041 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:38:58.256 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:39:01.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:39:01.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:39:01.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:39:01.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:39:01.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:39:01.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:39:01.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:39:01.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:39:01.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:39:01.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:39:01.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:39:01.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:39:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:39:01.649 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:39:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:39:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:39:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:39:01.650 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:39:01.996 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:39:02.665 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:39:04.578 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:39:04.825 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:39:04.829 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:05.591 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:05.591 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:39:07.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:39:08.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:39:08.047 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:39:08.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:39:08.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:39:08.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:39:08.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:39:08.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:39:08.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:39:08.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:39:08.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:39:08.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:39:08.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:39:08.832 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:09.047 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:39:09.400 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:09.400 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:39:10.986 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:39:11.475 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:11.825 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:39:12.170 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:12.171 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:39:14.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:39:14.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:39:14.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:39:14.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:39:14.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:39:14.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:39:14.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:39:14.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:39:14.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:39:14.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:39:14.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:39:14.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:39:14.751 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.751 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.751 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.751 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:39:14.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:39:15.776 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:39:16.550 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:16.550 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:39:17.505 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:39:18.707 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:39:18.761 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:19.779 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:19.779 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:39:20.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:39:20.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:39:20.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:39:20.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:39:20.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:39:20.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:39:20.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:39:20.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:39:20.685 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:39:20.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:39:20.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:39:20.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:39:20.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:39:20.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:39:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:23.461 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:23.462 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:39:23.706 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:39:25.680 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:26.174 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:26.174 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:39:26.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:39:26.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:39:26.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:39:26.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:39:26.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:39:27.010 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:39:27.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:39:27.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:39:27.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:39:27.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:39:27.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:39:27.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:39:27.174 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.174 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:39:27.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:39:28.487 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:29.030 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:29.031 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:39:29.910 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:39:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:32.348 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:32.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:39:32.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:39:32.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:39:32.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:39:32.777 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:39:32.802 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:39:32.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:39:32.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:39:32.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:39:32.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:39:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:39:32.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:39:32.993 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:39:32.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:39:33.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:39:33.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:39:35.043 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:35.697 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:35.697 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:39:35.876 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:39:36.215 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:39:38.566 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:39.474 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:39.475 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:39:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:39:40.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:39:40.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:39:40.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:39:40.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:39:40.515 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:39:40.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:39:40.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:39:40.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:39:40.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:39:40.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:39:40.704 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:39:40.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:39:40.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:39:40.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:39:42.077 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:39:42.206 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:42.838 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:42.839 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:39:43.593 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:39:46.285 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:46.562 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:39:46.867 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:39:46.891 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:39:46.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:39:46.942 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:46.943 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:39:46.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:39:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:39:47.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:39:47.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:39:47.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:39:47.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:39:47.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:39:47.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:39:47.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:39:47.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:39:47.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:39:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:49.581 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:39:50.088 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:39:50.104 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:50.104 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:39:53.193 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:39:53.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:39:53.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:39:53.523 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:53.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:39:53.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:39:53.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:39:53.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:39:53.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:39:53.676 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:39:53.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:39:53.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:39:53.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:39:53.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:39:53.783 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:39:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:39:54.568 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:54.569 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:39:56.007 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:39:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:39:56.727 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:39:57.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:39:57.374 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:40:00.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:00.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:00.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:00.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:00.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:00.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:00.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:00.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:00.505 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:40:00.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:00.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:00.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:00.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:00.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:40:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:40:01.392 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:40:01.393 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:40:03.650 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:40:03.690 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:40:03.851 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:40:04.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:40:04.345 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:40:07.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:07.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:07.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:07.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:07.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:07.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:07.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:07.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:07.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:07.357 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:40:07.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:07.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:07.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:07.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:40:07.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:40:08.065 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:40:08.085 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:40:08.086 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:40:10.241 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:40:10.300 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:40:10.615 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:40:11.028 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:40:11.028 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:40:13.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:13.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:13.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:13.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:13.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:13.899 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:13.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:13.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:13.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:14.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:14.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:14.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:14.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:40:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:40:14.820 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:40:14.903 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:40:14.904 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:40:16.758 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:40:17.076 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:40:17.336 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:40:17.930 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:40:17.931 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:40:19.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:19.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:19.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:19.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:19.840 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:19.866 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:19.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:19.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:19.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:20.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:20.029 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:20.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:20.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:40:20.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:40:21.223 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:40:21.766 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:40:21.801 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:40:21.802 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:40:22.909 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:40:24.261 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:40:24.422 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:40:25.412 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:40:25.412 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:40:25.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:25.780 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:25.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:25.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:25.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:25.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:25.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:25.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:25.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:26.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:26.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:26.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:40:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:40:28.105 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:40:28.184 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:40:28.981 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:40:29.014 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:40:30.799 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:40:31.483 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:40:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:31.748 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:31.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:31.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:31.824 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:31.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:31.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:31.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:31.962 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:31.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:32.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:32.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:32.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.066 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.066 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.066 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.066 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:40:32.297 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:40:34.813 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:40:34.846 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:40:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:40:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:40:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:40:34.847 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:40:34.944 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:40:35.626 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:40:37.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:37.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:37.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:37.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:37.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:37.959 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:40:37.971 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:37.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:38.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:38.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:38.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:38.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:38.139 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:38.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:40:38.168 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:40:39.321 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:40:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:40:41.056 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:40:41.854 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:40:42.516 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:40:43.673 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:43.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:43.719 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:40:43.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:43.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:43.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:43.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:43.824 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:43.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:43.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:43.904 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:43.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:43.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:43.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:40:43.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:40:45.471 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:40:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:40:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:40:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:40:45.472 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:40:46.104 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:40:46.632 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:40:47.118 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:40:48.958 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:40:48.958 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:40:48.959 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:40:48.959 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:40:49.644 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:40:49.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:49.766 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:49.797 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:49.824 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:49.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:49.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:49.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:49.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:49.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:49.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:50.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:50.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:40:50.180 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:40:52.199 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:40:52.710 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:40:52.921 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:40:53.388 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:40:55.669 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:40:56.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:40:56.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:40:56.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:40:56.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:40:56.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:40:56.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:40:56.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:40:56.249 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:40:56.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:40:56.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:40:56.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:40:56.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:40:56.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:40:56.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:40:56.648 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:40:58.871 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:40:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:40:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:40:58.872 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:40:58.926 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:40:59.439 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:40:59.480 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:41:01.970 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:41:01.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:41:02.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:41:02.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:41:02.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:41:02.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:41:02.138 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:41:02.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:41:02.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:41:02.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:41:02.234 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:41:02.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:41:02.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:41:02.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:41:02.298 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.298 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.298 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.298 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.298 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:41:02.299 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:41:03.006 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:41:05.256 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:41:05.663 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:41:06.444 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:41:07.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:41:07.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:41:07.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:41:07.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:41:07.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:41:07.971 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:41:07.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:41:08.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:41:08.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:41:08.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:41:08.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:41:08.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:41:08.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:41:08.387 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:09.050 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:09.051 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:41:10.722 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:41:11.031 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:11.670 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:11.671 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:41:13.732 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:14.236 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:14.237 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:41:15.737 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:41:16.335 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:16.858 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:16.859 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:41:18.391 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:41:18.967 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:19.625 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:19.625 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:41:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:41:22.315 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:22.316 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:41:23.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:41:23.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:41:23.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:41:23.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:41:23.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:41:23.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:41:23.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:41:23.293 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:41:23.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:41:23.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:41:23.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:41:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:41:23.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:41:24.695 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:41:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:25.300 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:25.300 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:41:26.157 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:41:28.425 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:28.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:41:29.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:41:29.016 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:29.017 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:41:29.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:41:29.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:41:29.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:41:29.094 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:41:29.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:41:29.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:41:29.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:41:29.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:41:29.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:41:29.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:41:29.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:41:29.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:41:29.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:41:31.542 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:31.603 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:41:32.111 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:32.111 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:41:32.261 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:41:34.927 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:41:35.117 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:35.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:41:35.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:41:35.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:41:35.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:41:35.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:41:35.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:41:35.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:41:35.441 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:41:35.467 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:41:35.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:41:35.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:41:35.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:41:35.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:41:35.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:41:36.199 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:36.200 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:41:37.864 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:41:38.239 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:38.354 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:41:38.950 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:38.950 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:41:41.886 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:42.066 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:41:42.450 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:42.451 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:41:44.437 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:44.783 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:41:44.996 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:44.996 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:41:47.370 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:47.845 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:47.846 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:41:47.864 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:41:49.937 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:50.331 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:41:50.428 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:50.429 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:41:51.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:41:51.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:41:51.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:41:52.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:41:52.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:41:52.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:41:52.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:41:52.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:41:52.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:41:52.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:41:52.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:41:52.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:41:52.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:41:52.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:41:53.122 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:53.253 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:41:53.801 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:53.801 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:41:54.931 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:41:55.961 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:41:55.989 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:41:56.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:41:56.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:41:57.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:41:57.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:41:57.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:41:57.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:41:57.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:41:57.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:41:57.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:41:57.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:41:57.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:41:57.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:41:57.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:41:57.911 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:41:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:41:57.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:41:59.700 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:41:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:42:00.541 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:42:00.616 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:42:00.616 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:42:02.452 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:42:02.967 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:02.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:03.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:03.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:03.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:03.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:03.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:03.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:03.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:42:03.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:03.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:03.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:03.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:42:03.860 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:42:03.860 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:42:06.104 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:42:06.292 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:42:06.369 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:42:07.002 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:42:07.002 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:42:08.675 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:42:09.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:09.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:09.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:09.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:09.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:09.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:09.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:09.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:09.320 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:42:09.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:09.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:09.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:09.408 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:09.410 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.410 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.410 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.410 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.410 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.410 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.411 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.411 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.411 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.411 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.411 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:42:09.411 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:42:10.204 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:42:10.205 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:42:12.125 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:42:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:42:12.509 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:42:13.120 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:42:13.120 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:42:14.750 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:42:15.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:15.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:15.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:15.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:15.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:15.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:15.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:15.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:15.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:15.406 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:42:15.408 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:15.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:15.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:42:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:42:16.277 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:42:16.278 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:42:18.205 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:42:18.464 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:42:18.571 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:42:19.199 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:42:19.200 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:42:20.888 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:42:21.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:21.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:21.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:21.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:21.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:21.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:21.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:21.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:21.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:42:21.576 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:42:22.688 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:42:24.329 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:42:24.376 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:42:25.217 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:42:25.816 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:42:26.968 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:42:27.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:27.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:27.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:27.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:27.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:27.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:27.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:27.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:27.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:27.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:27.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:27.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:27.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:42:27.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:42:28.710 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:42:28.710 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:42:28.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:42:28.711 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:42:28.711 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:42:29.358 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:42:29.846 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:42:30.759 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:42:31.452 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:42:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:42:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:42:31.453 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:42:32.113 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:42:32.477 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:42:33.423 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:33.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:33.471 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:33.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:33.522 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:33.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:33.575 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:33.602 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:33.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:33.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:33.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:33.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:33.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:42:33.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:42:35.356 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:42:35.813 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:42:36.009 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:42:36.416 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:42:38.483 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:42:38.661 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:42:38.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:38.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:38.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:38.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:38.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:38.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:38.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:38.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:38.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:38.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:39.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:39.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.034 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:42:39.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:42:41.895 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:42:42.087 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:42:42.087 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:42:42.087 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:42:42.088 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:42:42.844 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:42:42.866 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:42:45.041 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:45.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:45.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:45.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:45.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:45.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:45.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:45.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:45.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:45.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:45.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:45.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:45.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:42:45.483 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:42:45.946 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:42:46.567 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:42:47.938 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:42:48.884 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:42:49.723 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:42:50.439 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:42:50.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:50.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:50.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:50.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:50.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:50.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:51.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:51.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:51.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:51.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:51.117 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:51.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:51.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:42:51.729 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:42:52.936 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:42:52.936 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:42:52.936 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:42:52.936 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:42:53.597 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:42:53.927 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:42:54.844 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:42:56.223 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:42:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:42:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:42:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:42:56.224 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:42:56.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:42:56.840 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:42:56.844 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:42:56.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:42:56.909 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:42:56.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:42:56.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:42:56.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:42:57.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:42:57.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:42:57.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:42:57.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:42:57.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:42:57.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:42:57.794 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:42:59.315 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:42:59.916 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:42:59.957 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:43:00.832 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:43:02.645 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:02.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:02.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:02.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:02.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:03.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:03.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:03.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:03.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:03.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:03.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:03.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:03.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:43:03.372 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:03.373 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:43:03.663 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:43:05.825 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:43:05.979 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:06.550 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:06.551 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:43:07.134 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:43:09.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:09.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:09.118 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:09.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:09.170 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:09.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:09.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:09.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:09.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:09.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:09.330 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:09.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:09.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:09.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:43:09.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:43:10.040 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:10.040 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:43:10.069 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:43:12.202 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:43:12.751 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:13.178 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:43:13.456 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:13.456 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:43:15.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:15.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:15.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:15.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:15.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:15.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:15.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:15.482 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:15.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:15.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:15.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:15.599 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:15.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:43:15.809 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:16.008 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:43:16.637 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:16.637 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:43:18.414 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:43:19.072 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:19.288 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:43:19.760 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:19.761 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:43:21.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:21.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:21.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:21.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:21.818 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:21.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:21.871 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:21.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:21.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:21.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:21.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:22.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:22.035 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.035 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.035 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.035 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:43:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:22.289 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:43:23.065 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:23.065 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:43:24.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:43:25.454 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:25.895 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:43:26.108 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:26.108 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:43:27.840 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:27.863 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:27.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:27.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:27.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:27.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:28.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:28.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:28.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:28.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:28.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:28.153 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:43:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:28.641 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:43:29.102 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:29.103 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:43:30.772 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:43:31.401 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:32.118 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:43:32.130 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:32.131 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:43:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:33.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:33.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:33.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:33.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:33.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:33.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:33.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:33.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:33.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:33.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:33.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:33.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:43:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:43:34.856 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:43:34.989 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:35.742 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:35.742 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:43:36.511 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:43:38.855 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:43:38.913 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:39.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:39.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:39.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:39.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:39.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:39.569 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:39.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:39.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:39.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:39.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:39.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:39.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:43:39.869 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:39.869 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:43:41.502 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:43:41.869 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:42.229 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:43:42.631 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:42.631 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:43:45.109 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:45.124 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:43:45.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:45.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:45.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:45.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:45.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:45.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:45.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:45.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:45.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:45.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:45.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:45.996 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:45.997 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:43:46.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:46.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:43:46.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:43:48.173 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:43:48.200 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:48.530 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:43:48.801 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:48.801 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:43:51.792 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:52.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:52.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:52.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:52.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:52.122 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:43:52.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:52.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:52.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:52.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:52.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:52.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:52.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:52.390 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:52.391 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:43:52.399 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:52.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:43:52.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:43:54.922 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:54.959 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:43:55.246 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:43:55.553 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:55.554 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:43:58.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:43:58.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:43:58.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:43:58.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:43:58.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:43:58.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:43:58.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:43:58.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:43:58.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:43:58.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:43:58.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:43:58.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:43:58.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:43:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:43:59.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:43:59.709 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:44:01.554 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:44:01.754 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:44:02.504 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:44:02.504 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:44:04.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:04.301 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:04.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:04.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:04.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:04.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:04.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:04.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:04.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:04.574 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:04.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:04.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:04.666 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.666 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.667 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:44:04.880 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:44:05.629 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:44:05.630 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:44:07.284 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:44:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:44:08.506 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:44:08.507 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:44:08.884 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:44:10.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:10.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:10.115 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:10.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:10.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:10.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:10.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:10.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:10.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:10.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:10.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:10.399 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:44:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:44:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:44:11.666 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:44:12.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:44:12.190 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:44:13.003 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:44:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:44:14.946 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:44:15.876 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:44:15.877 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:44:16.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:16.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:16.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:16.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:16.369 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:16.396 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:16.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:16.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:16.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:16.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:16.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:16.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:44:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:44:17.611 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:44:18.227 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:44:18.876 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:44:18.876 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:44:19.430 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:44:20.858 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:44:21.405 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:44:21.405 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:44:21.405 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:44:21.405 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:44:22.238 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:44:22.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:22.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:22.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:22.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:22.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:22.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:22.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:22.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:22.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:22.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:22.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:22.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:44:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:44:24.014 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:44:24.443 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:44:25.231 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:44:25.919 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:44:27.170 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:44:28.346 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:44:29.090 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:44:29.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:29.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:29.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:29.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:29.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:29.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:29.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:29.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:29.566 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:29.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:29.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:29.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:44:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:44:30.167 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:44:31.716 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:44:31.716 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:44:31.716 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:44:31.716 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:44:32.246 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:44:32.309 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:44:33.200 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:44:35.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:35.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:35.139 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:35.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:35.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:35.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:35.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:35.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:35.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:35.306 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:44:35.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:35.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:35.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:44:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:44:36.043 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:44:36.290 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:44:38.227 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:44:38.528 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:44:39.240 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:44:39.300 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:44:41.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:41.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:41.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:41.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:41.361 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:41.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:41.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:41.438 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:41.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:41.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:41.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:41.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:41.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:44:41.836 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:44:42.117 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:44:42.118 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:44:42.118 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:44:42.118 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:44:42.839 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:44:44.223 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:44:44.866 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:44:46.118 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:44:46.118 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:44:46.118 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:44:46.119 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:44:46.119 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:44:46.785 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:44:47.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:47.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:47.093 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:47.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:47.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:47.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:47.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:47.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:47.247 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:47.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:47.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:44:47.740 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:44:49.029 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:44:49.868 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:44:49.968 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:44:50.893 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:44:52.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:52.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:52.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:52.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:52.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:52.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:52.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:52.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:52.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:52.931 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:44:52.931 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:44:52.932 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:44:52.932 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:44:52.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:52.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:52.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:44:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:44:53.650 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:44:53.662 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:44:55.826 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:44:56.316 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:44:56.317 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:44:56.317 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:44:56.317 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:44:56.317 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:44:56.983 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:44:57.149 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:44:58.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:44:58.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:44:58.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:44:58.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:44:58.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:44:58.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:44:58.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:44:58.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:44:58.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:44:58.705 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:44:58.730 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:44:58.757 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:44:58.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:44:58.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:44:59.879 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:44:59.880 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:45:00.441 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:45:01.405 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:45:02.927 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:45:03.785 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:03.785 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:45:04.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:45:04.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:45:04.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:45:04.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:45:04.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:45:04.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:45:04.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:45:04.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:45:04.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:45:04.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:45:04.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:45:04.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:45:04.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:45:04.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:45:06.021 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:45:06.263 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:06.990 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:06.990 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:45:07.713 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:45:09.218 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:45:09.779 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:10.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:10.578 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:45:11.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:45:11.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:45:11.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:45:11.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:45:11.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:45:11.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:45:11.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:45:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:45:11.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:45:11.294 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:45:11.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:45:11.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:45:11.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:45:11.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:45:12.325 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:45:12.695 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:13.393 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:13.393 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:45:14.204 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:45:15.417 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:45:16.589 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:17.386 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:17.387 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:45:17.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:45:17.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:45:17.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:45:17.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:45:17.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:45:17.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:45:17.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:45:17.857 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:45:17.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:45:17.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:45:17.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:45:18.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:45:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:45:18.445 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:45:19.726 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:20.510 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:20.510 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:45:21.024 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:45:22.168 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:45:22.880 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:23.637 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:23.637 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:45:24.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:45:24.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:45:24.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:45:24.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:45:24.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:45:24.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:45:24.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:45:24.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:45:24.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:45:24.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:45:24.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:45:24.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:45:24.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.378 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:45:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:45:25.382 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:45:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:26.614 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:26.615 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:45:27.159 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:45:29.196 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:45:29.292 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:30.124 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:30.125 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:45:30.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:45:30.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:45:30.581 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:45:30.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:45:30.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:45:30.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:45:30.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:45:30.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:45:30.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:45:30.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:45:30.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:45:30.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:45:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:45:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:45:31.886 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:45:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:33.055 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:33.056 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:45:33.609 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:45:34.879 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:45:36.130 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:36.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:45:36.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:45:36.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:45:36.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:45:36.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:45:36.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:45:36.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:45:36.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:45:36.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:45:36.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:45:36.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:45:36.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:45:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:45:36.812 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:36.812 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:45:37.652 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:45:39.112 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:39.242 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:45:39.891 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:39.891 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:45:40.876 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:45:42.489 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:45:42.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:45:42.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:45:42.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:45:42.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:45:42.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:45:42.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:45:42.666 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:42.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:45:42.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:45:42.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:45:42.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:45:42.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:45:42.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:45:42.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:45:43.469 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:43.469 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:45:43.726 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:45:45.614 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:45:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:46.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:46.765 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:45:47.290 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:45:48.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:45:49.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:45:49.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:45:49.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:45:49.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:45:49.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:45:49.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:45:49.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:45:49.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:45:49.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:45:49.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:45:49.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:45:49.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:45:49.567 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:50.129 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:45:50.293 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:50.294 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:45:52.131 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:45:53.048 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:53.315 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:45:53.821 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:53.822 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:45:55.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:45:55.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:45:55.115 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:45:55.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:45:55.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:45:55.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:45:55.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:45:55.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:45:55.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:45:55.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:45:55.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:45:55.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:45:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:45:55.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:45:56.292 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:45:56.511 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:45:57.284 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:45:57.285 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:45:57.949 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:45:59.424 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:46:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:46:00.800 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:46:00.800 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:46:01.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:01.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:01.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:01.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:01.293 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:01.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:01.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:01.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:01.399 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:01.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:01.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:01.485 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:46:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:46:02.333 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:46:03.104 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:46:03.850 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:46:03.850 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:46:04.324 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:46:04.877 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:46:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:46:07.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:07.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:07.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:07.487 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:46:07.487 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:46:07.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:07.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:07.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:07.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:07.602 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:07.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:07.650 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:46:07.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:07.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:46:07.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:46:10.108 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:46:10.468 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:46:10.720 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:46:10.720 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:46:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:46:13.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:13.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:13.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:13.406 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:46:13.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:13.439 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:13.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:13.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:13.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:13.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:13.579 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:13.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:13.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:13.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:46:13.809 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:46:14.006 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:46:14.007 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:46:16.457 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:46:16.805 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:46:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:46:17.546 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:46:17.546 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:46:19.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:19.609 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:19.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:19.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:19.693 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:19.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:19.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:19.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:19.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:19.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:19.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:19.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:19.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:46:19.985 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:46:20.042 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:46:20.917 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:46:20.918 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:46:22.647 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:46:23.324 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:46:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:46:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:46:23.325 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:46:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:46:24.269 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:46:25.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:25.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:25.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:25.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:25.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:25.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:25.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:25.788 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:25.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:25.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:25.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:25.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:46:25.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:46:26.269 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:46:26.857 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:46:27.427 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:46:28.549 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:46:29.394 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:46:30.062 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:46:30.752 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:46:31.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:31.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:31.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:31.441 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:31.467 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:31.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:31.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:31.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:31.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:31.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:31.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:31.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:46:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:46:32.103 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:46:33.043 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:46:33.044 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:46:33.044 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:46:33.044 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:46:33.695 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:46:34.723 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:46:35.052 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:46:36.440 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:46:36.440 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:46:36.440 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:46:36.441 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:46:36.441 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:46:37.182 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:46:37.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:37.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:37.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:37.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:37.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:37.707 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:46:37.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:37.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:37.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:37.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:37.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:37.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:37.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:46:37.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:46:39.964 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:46:40.622 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:46:40.878 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:46:40.886 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:46:43.417 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:46:43.650 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:46:43.694 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:43.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:43.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:43.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:43.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:43.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:43.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:43.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:43.911 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:43.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:44.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:44.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.038 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.038 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.038 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.038 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:46:44.099 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:46:46.708 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:46:46.825 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:46:46.825 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:46:46.825 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:46:46.826 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:46:46.826 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:46:47.350 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:46:47.368 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:46:49.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:49.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:49.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:49.965 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:46:49.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:50.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:50.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:50.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:50.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:50.118 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:50.123 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:46:50.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:50.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:50.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:50.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:46:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:46:51.259 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:46:53.013 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:46:53.223 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:46:53.449 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:46:54.443 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:46:56.046 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:46:56.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:46:56.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:46:56.533 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:46:56.564 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:46:56.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:46:56.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:46:56.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:46:56.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:46:56.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:46:56.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:46:56.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:46:56.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:46:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:46:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:46:57.094 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:46:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:46:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:46:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:46:57.095 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:46:58.386 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:46:59.834 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:47:00.141 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:47:00.538 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:47:00.539 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:47:00.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:47:00.539 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:47:00.539 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:47:01.268 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:47:02.630 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:47:02.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:02.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:02.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:02.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:02.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:03.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:03.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:03.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:03.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:03.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:03.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:03.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:03.180 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:47:03.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:47:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:05.239 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:05.239 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:47:05.948 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:47:06.235 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:47:08.085 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:08.824 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:08.824 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:47:09.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:09.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:09.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:09.139 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:09.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:09.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:09.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:09.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:09.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:09.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:09.298 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:47:09.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:09.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:09.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:47:09.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:47:11.140 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:11.951 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:11.952 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:47:11.982 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:47:13.278 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:47:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:15.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:15.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:15.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:15.505 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:15.505 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:47:15.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:15.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:15.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:15.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:15.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:15.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:15.797 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:15.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:15.870 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:47:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:47:16.047 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:47:18.025 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:18.692 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:18.692 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:47:18.707 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:47:19.473 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:47:21.553 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:21.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:21.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:21.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:21.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:21.761 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:21.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:21.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:21.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:21.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:21.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:21.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:47:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:47:22.168 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:22.168 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:47:22.186 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:47:24.637 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:47:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:25.725 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:25.725 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:47:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:47:28.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:28.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:28.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:28.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:28.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:28.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:28.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:28.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:28.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:28.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:28.349 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:28.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:28.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:47:28.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:47:29.050 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:29.050 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:47:29.072 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:47:31.235 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:47:31.602 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:32.235 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:47:32.320 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:32.320 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:47:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:34.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:34.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:34.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:34.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:34.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:34.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:34.618 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:34.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:34.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:34.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:34.745 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:34.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:47:34.856 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:47:34.872 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:35.747 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:35.748 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:47:37.486 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:47:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:38.825 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:38.825 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:47:40.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:40.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:40.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:40.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:40.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:40.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:40.463 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:40.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:40.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:40.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:40.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:40.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:40.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:47:40.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:47:41.188 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:41.631 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:41.632 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:47:43.161 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:47:43.585 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:44.308 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:44.309 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:47:45.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:45.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:45.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:45.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:45.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:45.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:45.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:45.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:45.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:45.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:45.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:45.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:47:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:47:46.319 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:46.857 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:46.857 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:47:48.442 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:47:48.512 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:47:49.208 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:49.977 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:49.977 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:47:51.131 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:47:51.228 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:51.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:51.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:51.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:51.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:51.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:51.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:51.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:51.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:51.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:51.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:51.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:51.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.589 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:47:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:47:52.746 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:53.496 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:53.496 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:47:54.614 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:47:54.904 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:47:55.760 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:56.556 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:56.557 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:47:57.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:47:57.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:47:57.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:47:57.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:47:57.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:47:57.540 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:47:57.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:47:57.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:47:57.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:47:57.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:47:57.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:47:57.694 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:47:57.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:47:57.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:47:57.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:47:59.198 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:47:59.864 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:47:59.865 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:48:00.827 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:48:00.911 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:48:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:48:03.145 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:48:03.145 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:48:03.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:03.718 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:03.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:03.777 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:03.785 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:48:03.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:03.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:03.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:03.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:03.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:03.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:03.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:03.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:04.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:48:04.002 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:48:05.710 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:48:06.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:48:06.344 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:48:06.973 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:48:07.737 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:48:09.353 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:48:09.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:09.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:09.943 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:48:09.943 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:48:09.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:09.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:10.010 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:10.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:10.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:10.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:10.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:10.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:10.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:10.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:10.210 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.210 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.210 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.211 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:48:10.429 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:48:12.536 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:48:13.062 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:48:13.163 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:48:13.163 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:48:13.785 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:48:15.962 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:16.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:16.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:16.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:16.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:16.099 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:48:16.118 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:16.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:16.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:16.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:16.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:16.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:16.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.251 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.252 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:48:16.450 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:48:16.703 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:48:16.704 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:48:19.061 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:48:19.550 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:48:19.827 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:48:20.196 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:48:20.196 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:48:21.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:21.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:21.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:21.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:21.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:21.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:21.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:21.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:21.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:21.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:21.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:21.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:48:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:48:22.846 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:48:22.997 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:48:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:48:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:48:22.998 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:48:23.780 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:48:24.724 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:48:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:48:26.762 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:48:26.763 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:48:26.763 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:48:26.763 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:48:26.763 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:48:27.556 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:48:28.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:28.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:28.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:28.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:28.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:28.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:28.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:28.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:28.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:28.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:28.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:28.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:28.506 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:48:28.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:48:29.021 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:48:29.829 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:48:30.561 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:48:31.378 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:48:32.277 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:48:33.756 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:48:34.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:34.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:34.379 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:48:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:34.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:34.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:34.522 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:34.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:34.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:34.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:34.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:34.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:34.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.683 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.683 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.683 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.683 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.683 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.683 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.683 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:48:34.684 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:48:35.056 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:48:36.588 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:48:36.588 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:48:36.588 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:48:36.589 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:48:36.589 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:48:37.422 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:48:37.455 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:48:39.201 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:48:40.285 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:48:40.286 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:48:40.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:48:40.286 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:48:40.286 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:48:40.371 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:40.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:40.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:40.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:40.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:40.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:40.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:40.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:40.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:40.618 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:40.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:40.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:48:40.848 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:48:41.973 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:48:43.229 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:48:43.374 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:48:44.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:48:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:48:46.602 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:46.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:46.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:46.694 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:46.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:46.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:46.773 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:46.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:46.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:46.845 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:48:46.846 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:48:46.846 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:48:46.846 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:48:46.846 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:48:46.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:46.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:46.904 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:46.905 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:48:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:48:47.585 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:48:48.373 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:48:49.747 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:48:49.747 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:48:49.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:48:49.747 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:48:49.748 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:48:49.756 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:48:50.654 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:48:52.267 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:48:52.728 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:52.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:52.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:52.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:52.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:52.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:52.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:53.010 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:53.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:53.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:53.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:53.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:48:53.790 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:48:54.302 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:48:55.124 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:48:55.736 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:48:56.433 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:48:57.329 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:48:58.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:48:58.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:48:58.704 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:48:58.734 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:48:58.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:48:58.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:48:58.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:48:58.831 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:48:58.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:48:58.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:48:58.891 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:48:58.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:48:58.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:48:58.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:48:58.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:49:00.419 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:49:00.419 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:49:00.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:49:00.419 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:49:00.419 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:49:00.979 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:49:01.622 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:49:01.944 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:49:04.073 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:04.962 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:04.962 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:49:05.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:49:05.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:49:05.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:49:05.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:49:05.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:49:05.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:49:05.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:49:05.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:49:05.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:49:05.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:49:05.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:49:05.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:49:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:49:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:49:06.344 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:49:07.432 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:08.051 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:08.052 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:49:08.412 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:49:09.025 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:49:10.875 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:11.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:49:11.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:49:11.699 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:11.699 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:49:11.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:49:11.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:49:11.797 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:49:11.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:49:11.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:49:11.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:49:11.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:49:11.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:49:11.971 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:49:12.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:49:12.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:49:12.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:49:13.299 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:49:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:14.330 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:14.331 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:49:14.766 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:49:15.888 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:49:16.811 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:17.539 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:17.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:49:17.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:49:17.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:49:17.980 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:49:18.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:49:18.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:49:18.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:49:18.106 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:49:18.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:49:18.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:49:18.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:49:18.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:49:18.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:49:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:49:18.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:49:19.839 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:49:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:20.790 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:20.791 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:49:21.041 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:49:22.511 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:49:23.208 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:23.441 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:49:23.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:49:23.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:49:23.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:49:23.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:49:23.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:49:23.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:49:23.612 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:49:23.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:49:23.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:49:23.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:49:23.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:49:23.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:49:23.973 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:23.974 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:49:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:26.481 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:49:26.858 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:49:27.195 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:27.196 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:49:29.373 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:49:29.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:49:29.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:49:29.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:49:29.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:49:29.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:49:29.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:49:29.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:49:29.700 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:29.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:49:29.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:49:29.757 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:49:29.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:49:29.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:49:29.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.815 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:49:29.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:49:30.482 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:30.482 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:49:32.952 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:49:33.014 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:49:33.711 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:33.712 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:49:35.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:49:36.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:49:36.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:49:36.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:49:36.093 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:49:36.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:49:36.139 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:49:36.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:49:36.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:49:36.187 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:36.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:49:36.226 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:49:36.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:49:36.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:49:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:49:36.911 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:36.911 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:49:39.265 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:49:39.389 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:39.842 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:49:40.017 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:40.018 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:49:42.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:49:42.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:49:42.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:49:42.515 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:49:42.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:49:42.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:49:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:42.583 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:49:42.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:49:42.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:49:42.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:49:42.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:49:42.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:49:42.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:49:42.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:49:42.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:49:43.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:43.216 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:49:45.717 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:45.784 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:49:46.318 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:49:46.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:46.359 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:49:48.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:49:48.844 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:49:48.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:49:48.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:49:48.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:49:48.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:49:48.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:49:48.991 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:49:49.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:49:49.044 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:49.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:49:49.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:49:49.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:49:49.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:49:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:49:49.807 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:49.807 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:49:52.119 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:49:52.453 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:53.114 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:53.115 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:49:53.367 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:49:55.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:49:55.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:49:55.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:49:55.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:49:55.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:49:55.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:49:55.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:49:55.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:49:55.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:49:55.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:49:55.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:49:55.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:49:55.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:49:55.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:49:56.118 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:56.429 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:49:56.601 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:49:56.601 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:49:58.119 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:49:59.263 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:49:59.390 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:50:00.396 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:50:00.397 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:50:00.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:00.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:01.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:01.047 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:01.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:01.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:01.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:01.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:01.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:01.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:01.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:50:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:50:02.397 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:50:02.727 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:50:03.383 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:50:03.383 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:50:04.182 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:50:05.243 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:50:06.864 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:50:07.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:07.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:07.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:07.457 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:50:07.458 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:50:07.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:07.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:07.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:07.579 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:07.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:07.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:07.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:07.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:07.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:07.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:50:07.916 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:50:10.227 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:50:10.456 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:50:10.827 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:50:10.828 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:50:11.360 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:50:13.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:13.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:13.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:13.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:13.339 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:50:13.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:13.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:13.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:13.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:13.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:13.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:13.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:13.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:13.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:50:13.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:50:13.890 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:50:14.540 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:50:16.281 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:50:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:50:17.342 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:50:17.342 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:50:17.832 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:50:19.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:19.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:19.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:19.866 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:19.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:19.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:19.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:19.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:20.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:20.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:20.055 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:50:20.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:20.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.104 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:50:20.788 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:50:20.788 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:50:20.920 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:50:22.926 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:50:23.317 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:50:23.804 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:50:24.167 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:50:25.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:25.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:25.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:25.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:25.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:25.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:25.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:25.728 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:25.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:25.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:25.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:25.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:25.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.856 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.857 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.858 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:50:25.858 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:50:26.675 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:50:27.111 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:50:27.111 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:50:27.111 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:50:27.111 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:50:27.112 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:50:27.860 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:50:28.467 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:50:29.882 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:50:30.498 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:50:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:50:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:50:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:50:30.499 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:50:31.282 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:50:31.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:31.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:31.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:31.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:31.780 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:31.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:31.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:31.860 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:31.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:31.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:31.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:50:31.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:50:33.018 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:50:33.645 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:50:34.280 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:50:34.840 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:50:35.669 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:50:37.390 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:50:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:37.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:37.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:37.745 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:37.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:37.798 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:37.824 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:37.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:37.891 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:37.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:37.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:37.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:50:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:50:38.144 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:50:38.587 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:50:40.557 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:50:40.758 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:50:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:50:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:50:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:50:40.758 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:50:41.584 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:50:41.945 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:50:43.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:43.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:43.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:44.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:44.047 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:44.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:44.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:44.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:44.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:44.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:44.202 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:50:44.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:44.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:44.233 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.233 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.233 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.233 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.233 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:50:44.968 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:50:45.066 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:50:47.120 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:50:47.423 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:50:47.954 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:50:48.311 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:50:50.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:50.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:50.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:50.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:50.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:50.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:50.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:50.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:50.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:50.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:50.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:50.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:50:50.834 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:50:50.920 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:50:50.920 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:50:50.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:50:50.921 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:50:50.921 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:50:51.419 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:50:52.979 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:50:53.902 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:50:53.902 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:50:53.902 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:50:53.902 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:50:53.981 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:50:54.581 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:50:56.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:50:56.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:50:56.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:50:56.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:50:56.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:50:56.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:50:56.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:50:56.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:50:56.357 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:50:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:50:56.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:50:56.467 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:50:56.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:50:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:50:57.428 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:50:57.518 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:50:58.121 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:50:59.172 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:51:00.942 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:51:01.109 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:51:01.976 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:51:02.361 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:51:02.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:51:02.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:51:02.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:51:02.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:51:02.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:51:02.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:51:02.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:51:02.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:51:02.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:51:02.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:51:02.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:51:02.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:51:02.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:51:03.709 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:51:04.213 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:04.830 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:04.830 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:51:05.465 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:51:06.738 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:51:07.871 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:08.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:51:08.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:51:08.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:51:08.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:51:08.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:51:08.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:51:08.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:51:08.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:51:08.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:51:08.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:51:08.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:51:08.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:51:08.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:51:08.563 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:08.564 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:51:09.729 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:51:10.893 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:10.971 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:51:12.039 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:12.039 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:51:13.774 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:51:13.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:51:13.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:51:13.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:51:13.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:51:14.010 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:51:14.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:51:14.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:51:14.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:51:14.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:51:14.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:51:14.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:51:14.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:51:14.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:51:14.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:51:15.225 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:15.781 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:15.782 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:51:16.538 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:51:16.960 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:51:18.930 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:19.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:19.733 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:51:19.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:51:19.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:51:19.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:51:19.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:51:19.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:51:19.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:51:20.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:51:20.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:51:20.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:51:20.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:51:20.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:51:20.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:51:20.180 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.180 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.180 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.180 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.180 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.180 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:51:20.890 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:51:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:22.705 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:22.705 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:51:22.838 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:51:23.654 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:51:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:26.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:51:26.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:26.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:51:26.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:51:26.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:51:26.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:51:26.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:51:26.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:51:26.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:51:26.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:51:26.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:51:26.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:51:26.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:51:26.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:51:26.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.653 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:51:26.653 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:51:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:51:28.759 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:29.360 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:29.361 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:51:29.479 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:51:30.239 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:51:32.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:51:32.566 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:51:32.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:51:32.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:51:32.613 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:32.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:51:32.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:51:32.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:51:32.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:51:32.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:51:32.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:51:32.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:51:32.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:51:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:51:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:51:33.254 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:33.254 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:51:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:51:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:35.615 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:51:36.163 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:36.163 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:51:36.992 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:51:38.512 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:51:38.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:51:38.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:51:38.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:51:38.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:51:38.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:51:38.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:51:38.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:51:38.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:51:38.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:51:38.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:51:38.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:51:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:51:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:51:39.011 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:39.873 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:39.873 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:51:41.606 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:51:41.948 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:42.713 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:42.714 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:51:43.867 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:51:43.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:51:43.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:51:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:51:43.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:51:43.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:51:44.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:51:44.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:51:44.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:51:44.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:51:44.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:51:44.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:51:44.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:51:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:51:45.024 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:45.514 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:45.514 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:51:46.833 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:51:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:48.122 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:48.122 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:51:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:50.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:50.765 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:51:50.993 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:51:53.039 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:53.615 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:53.615 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:51:53.657 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:51:55.992 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:56.582 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:56.582 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:51:57.367 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:51:58.939 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:51:59.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:51:59.566 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:51:59.567 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:51:59.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:51:59.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:51:59.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:51:59.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:51:59.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:51:59.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:51:59.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:51:59.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:51:59.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:51:59.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:51:59.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:51:59.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.899 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:51:59.899 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:52:00.154 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:52:02.282 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:52:02.783 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:52:02.914 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:52:02.915 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:52:03.373 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:52:05.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:05.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:05.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:05.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:05.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:05.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:05.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:52:05.675 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:52:05.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:52:05.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:52:05.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:52:05.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:52:05.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:52:05.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:52:05.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:52:06.378 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:52:06.378 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:52:06.395 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:52:08.524 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:52:08.938 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:52:09.568 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:52:09.620 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:52:09.621 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:52:11.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:11.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:11.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:11.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:11.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:11.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:11.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:52:11.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:52:11.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:52:11.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:52:11.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:52:11.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:52:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:52:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:52:12.185 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:52:12.718 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:52:13.402 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:52:13.402 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:52:14.349 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:52:15.074 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:52:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:52:17.200 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:52:17.200 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:52:17.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:17.798 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:17.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:17.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:17.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:52:17.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:17.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:17.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:52:17.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:52:18.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:52:18.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:52:18.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:52:18.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:52:18.099 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.099 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.099 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:52:18.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:52:19.728 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:52:20.225 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:52:20.226 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:52:20.955 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:52:20.984 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:52:22.971 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:52:23.627 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:52:23.660 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:52:24.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:24.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:24.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:24.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:24.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:24.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:52:24.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:52:24.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:52:24.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:52:24.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:52:24.369 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:52:24.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.371 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:52:24.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:52:26.734 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:52:26.735 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:52:26.735 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:52:26.735 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:52:26.735 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:52:27.134 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:52:27.310 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:52:27.369 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:52:29.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:29.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:29.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:29.921 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:52:29.924 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:29.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:29.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:52:30.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:52:30.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:52:30.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:52:30.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:52:30.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:52:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:52:30.344 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:52:30.554 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:52:33.056 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:52:33.144 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:52:33.389 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:52:33.705 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:52:36.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:36.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:36.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:36.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:36.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:36.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:36.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:52:36.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:52:36.345 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:52:36.345 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:52:36.345 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:52:36.345 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:52:36.346 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:52:36.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:52:36.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:52:36.391 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:52:36.412 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:52:36.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:52:36.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:52:36.458 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:52:37.102 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:52:39.333 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:52:39.686 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:52:39.686 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:52:39.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:52:39.686 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:52:39.686 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:52:39.842 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:52:40.606 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:52:41.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:41.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:41.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:41.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:42.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:42.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:42.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:52:42.088 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:52:42.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:52:42.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:52:42.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:52:42.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:52:42.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.194 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.196 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:52:42.900 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:52:43.258 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:52:43.887 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:52:44.990 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:52:45.973 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:52:46.891 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:52:47.531 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:52:48.106 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:48.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:48.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:48.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:48.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:48.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:52:48.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:52:48.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:52:48.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:52:48.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:52:48.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:52:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:52:48.735 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:52:50.050 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:52:50.050 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:52:50.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:52:50.050 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:52:50.050 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:52:50.838 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:52:51.236 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:52:52.399 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:52:53.661 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:52:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:52:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:52:53.662 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:52:54.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:54.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:54.253 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:52:54.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:54.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:54.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:54.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:54.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:52:54.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:52:54.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:52:54.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:52:54.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:52:54.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:52:54.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:52:54.503 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:52:55.215 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:52:57.161 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:52:57.210 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:52:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:52:58.088 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:52:59.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:52:59.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:52:59.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:52:59.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:52:59.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:52:59.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:52:59.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:00.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:00.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:00.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:00.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:00.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:00.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:53:00.710 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:53:01.138 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:53:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:53:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:53:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:53:01.138 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:53:02.043 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:53:02.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:53:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:53:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:05.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:53:05.922 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:05.923 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:53:05.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:53:05.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:53:05.988 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:53:06.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:53:06.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:53:06.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:06.093 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:06.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:06.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:06.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:06.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:06.200 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.200 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.200 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.200 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:53:06.327 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:53:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:09.158 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:09.159 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:53:09.217 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:53:09.844 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:53:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:12.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:53:12.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:53:12.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:53:12.490 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:12.490 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:53:12.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:53:12.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:53:12.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:53:12.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:12.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:12.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:12.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:12.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:12.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:12.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:53:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:53:13.155 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:53:15.322 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:15.463 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:53:15.936 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:15.937 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:53:16.834 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:53:18.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:53:18.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:53:18.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:53:18.497 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:18.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:53:18.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:53:18.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:53:18.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:18.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:18.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:18.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:18.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:18.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:18.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.784 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:53:18.785 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:53:19.081 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:19.081 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:53:19.980 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:53:21.264 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:21.451 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:53:22.172 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:22.173 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:53:23.410 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:53:24.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:53:24.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:53:24.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:53:24.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:53:24.860 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:53:24.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:53:24.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:24.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:24.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:24.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:25.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:25.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.053 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:53:25.500 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:25.501 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:53:26.228 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:53:27.869 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:53:27.973 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:28.512 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:28.513 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:53:30.455 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:53:31.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:53:31.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:53:31.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:53:31.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:53:31.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:53:31.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:53:31.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:31.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:31.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:31.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:31.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:31.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:31.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:53:31.576 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:32.352 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:32.352 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:53:33.244 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:53:33.929 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:53:34.962 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:36.200 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:36.200 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:53:36.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:53:36.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:53:36.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:53:36.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:53:36.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:53:36.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:53:36.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:37.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:37.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:37.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:37.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:37.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:37.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.145 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:53:37.406 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:53:38.852 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:39.441 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:39.442 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:53:40.130 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:53:40.415 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:53:42.188 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:43.051 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:43.051 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:53:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:53:43.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:53:43.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:53:43.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:53:43.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:53:43.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:53:43.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:53:43.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:43.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:43.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:43.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:43.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:43.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:53:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:53:45.623 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:46.182 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:53:46.198 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:46.198 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:53:46.749 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:53:49.227 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:50.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:53:50.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:53:50.086 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:50.086 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:53:50.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:53:50.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:53:50.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:53:50.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:53:50.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:50.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:50.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:50.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:50.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:50.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:50.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:53:50.549 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:53:52.400 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:52.997 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:52.998 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:53:53.341 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:53:53.629 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:53:56.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:53:56.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:53:56.370 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:53:56.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:53:56.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:53:56.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:53:56.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:53:56.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:53:56.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:53:56.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:53:56.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:53:56.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:53:56.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:53:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:53:56.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:53:57.025 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:53:57.026 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:53:57.416 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:53:59.443 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:53:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:54:00.125 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:54:00.126 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:54:00.137 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:54:02.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:02.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:02.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:02.875 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:02.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:02.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:02.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:02.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:03.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:03.038 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:54:03.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:03.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:03.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:54:03.635 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:54:03.635 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:54:05.436 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:54:05.946 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:54:06.064 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:54:06.510 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:54:06.511 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:54:08.046 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:54:08.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:08.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:08.856 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:08.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:08.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:08.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:08.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:09.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:09.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:09.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:09.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:09.096 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:54:09.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:09.124 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.124 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.124 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:54:09.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:54:10.267 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:54:10.268 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:54:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:54:12.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:54:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:54:13.514 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:54:13.514 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:54:14.169 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:54:14.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:14.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:14.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:14.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:14.860 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:14.887 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:14.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:14.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:14.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:15.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:15.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:15.073 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.073 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.073 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.073 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.073 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.073 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.073 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:54:15.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:54:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:54:17.295 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:54:17.296 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:54:17.719 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:54:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:54:20.158 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:54:20.782 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:54:20.782 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:54:20.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:20.909 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:20.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:20.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:20.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:21.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:21.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:21.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:21.088 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:21.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:21.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:21.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:21.170 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.170 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.170 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.170 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.171 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.171 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.171 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.171 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.171 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.171 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.172 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.172 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:54:21.200 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:54:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:54:23.778 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:54:23.779 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:54:23.933 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:54:25.011 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:54:26.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:26.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:26.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:26.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:26.704 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:26.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:26.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:26.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:26.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:26.864 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:54:26.864 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:54:26.864 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:54:26.865 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:54:26.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:26.911 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:26.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:26.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.951 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:54:26.951 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:54:27.694 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:54:28.110 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:54:29.847 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:54:30.285 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:54:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:54:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:54:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:54:30.285 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:54:31.219 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:54:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:54:33.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:33.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:33.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:33.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:33.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:33.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:33.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:33.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:33.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:33.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:33.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:54:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:54:34.218 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:54:34.651 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:54:36.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:54:37.056 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:54:37.476 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:54:37.750 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:54:39.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:39.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:39.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:39.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:39.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:39.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:39.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:39.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:39.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:39.481 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:39.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:39.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:39.536 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.536 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.538 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.538 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:54:39.538 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:54:40.431 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:54:40.694 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:54:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:54:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:54:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:54:40.695 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:54:41.388 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:54:42.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:54:43.443 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:54:44.611 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:54:44.611 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:54:44.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:54:44.611 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:54:44.611 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:54:45.319 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:54:45.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:45.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:45.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:45.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:45.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:45.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:45.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:45.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:45.793 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:45.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:45.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:45.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:54:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:54:46.436 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:54:47.974 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:54:48.515 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:54:48.660 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:54:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:54:51.255 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:51.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:51.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:51.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:51.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:51.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:51.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:51.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:51.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:51.473 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:54:51.474 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:54:51.474 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:54:51.474 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:54:51.474 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:54:51.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:51.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:51.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:54:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:54:52.245 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:54:52.333 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:54:54.398 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:54:54.861 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:54:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:54:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:54:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:54:54.862 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:54:55.518 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:54:55.720 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:54:57.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:54:57.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:54:57.255 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:54:57.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:54:57.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:54:57.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:54:57.357 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:54:57.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:54:57.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:54:57.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:54:57.463 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:54:57.489 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:54:57.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:54:57.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:54:58.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:54:58.667 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:54:59.456 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:55:00.075 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:55:01.004 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:55:02.524 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:55:03.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:03.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:03.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:03.161 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:55:03.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:03.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:03.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:03.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:03.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:03.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:03.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:03.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:03.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:03.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:55:03.913 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:55:06.047 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:55:06.055 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:55:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:55:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:55:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:55:06.055 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:55:06.659 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:55:07.450 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:55:09.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:09.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:09.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:09.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:09.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:09.246 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:09.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:09.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:09.317 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:09.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:09.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:09.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:09.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:55:09.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:55:10.089 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:10.089 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:55:10.430 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:55:12.247 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:55:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:13.271 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:13.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:55:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:55:15.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:15.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:15.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:15.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:15.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:15.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:15.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:15.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:15.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:15.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:15.829 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:15.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:55:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:55:16.514 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:16.515 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:55:16.820 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:55:18.691 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:55:19.118 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:19.875 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:19.876 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:55:19.915 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:55:21.867 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:21.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:21.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:21.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:21.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:22.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:22.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:22.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:22.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:22.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:22.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:22.175 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:22.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:55:22.521 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:55:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:23.486 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:23.487 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:55:24.742 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:55:25.489 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:55:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:27.043 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:27.044 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:55:27.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:27.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:27.533 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:27.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:27.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:27.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:27.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:27.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:27.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:27.802 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:27.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:55:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:55:28.130 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:55:29.535 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:30.394 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:30.395 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:55:30.575 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:55:31.538 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:55:33.045 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:33.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:33.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:33.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:33.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:33.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:33.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:33.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:33.485 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:33.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:33.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:33.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:33.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:33.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.689 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.689 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.689 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.689 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.689 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.689 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:55:33.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:33.738 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:55:34.322 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:55:36.043 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:36.268 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:55:36.505 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:36.505 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:55:37.573 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:55:38.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:39.010 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:39.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:39.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:39.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:39.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:39.135 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:39.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:39.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:39.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:39.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:39.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:39.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:39.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:55:39.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:39.841 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:55:40.616 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:55:42.005 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:55:42.224 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:42.881 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:42.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:55:43.633 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:55:45.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:45.489 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:45.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:45.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:45.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:45.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:45.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:45.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:45.685 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:45.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:45.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:45.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:45.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.768 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.768 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.768 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.768 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.768 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:55:45.768 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:55:46.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:46.371 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:55:46.548 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:55:48.531 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:55:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:49.530 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:49.531 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:55:49.670 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:55:51.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:51.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:51.857 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:51.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:51.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:51.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:51.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:51.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:52.002 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:52.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:52.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:52.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:52.087 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:55:52.712 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:52.712 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:55:52.774 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:55:54.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:55:55.074 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:55.760 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:55.760 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:55:56.847 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:55:58.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:55:58.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:55:58.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:55:58.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:55:58.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:55:58.408 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:55:58.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:55:58.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:55:58.477 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:55:58.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:55:58.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:55:58.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:55:58.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:55:58.573 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.573 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.573 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:55:58.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:55:59.208 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:55:59.209 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:55:59.961 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:56:01.372 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:56:01.655 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:56:02.436 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:56:02.437 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:56:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:56:04.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:04.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:04.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:04.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:04.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:04.579 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:04.605 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:04.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:04.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:04.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:04.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:04.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:04.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:56:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:56:05.761 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:56:06.261 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:56:06.357 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:56:06.357 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:56:07.425 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:56:09.459 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:56:10.315 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:56:10.316 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:56:10.408 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:10.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:10.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:10.482 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:10.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:10.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:10.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:10.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:10.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:10.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:10.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:56:10.876 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:56:12.630 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:56:13.231 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:56:13.232 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:56:13.349 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:56:14.032 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:56:16.368 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:56:16.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:16.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:16.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:16.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:16.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:16.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:16.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:16.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:16.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:16.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:16.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:16.975 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:16.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.979 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:56:16.979 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:56:17.109 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:56:17.110 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:56:17.919 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:56:19.584 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:56:19.732 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:56:20.172 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:56:20.173 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:56:20.552 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:56:22.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:22.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:22.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:22.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:22.676 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:22.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:22.730 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:22.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:22.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:22.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:22.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:22.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:22.864 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.864 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.864 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.864 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:56:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:56:23.538 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:56:23.538 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:56:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:56:25.833 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:56:26.278 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:56:26.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:56:28.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:28.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:28.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:28.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:28.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:28.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:28.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:28.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:28.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:28.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:28.532 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:56:28.533 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:56:28.533 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:56:28.533 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:56:28.564 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:28.602 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:28.604 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.604 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:56:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:56:29.199 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:56:31.283 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:56:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:56:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:56:31.284 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:56:31.284 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:56:31.420 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:56:31.883 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:56:33.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:33.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:34.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:34.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:34.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:34.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:34.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:34.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:34.173 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:56:34.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:34.226 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:34.255 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:34.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:56:34.821 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:56:35.015 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:56:36.993 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:56:37.131 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:56:37.510 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:56:37.688 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:56:40.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:40.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:40.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:40.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:40.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:40.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:40.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:40.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:40.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:40.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:40.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:40.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:40.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:56:40.876 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:56:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:56:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:56:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:56:40.877 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:56:41.017 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:56:41.895 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:56:43.585 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:56:43.896 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:56:43.896 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:56:43.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:56:43.896 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:56:43.896 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:56:44.042 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:56:44.673 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:56:46.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:46.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:46.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:46.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:46.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:46.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:46.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:46.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:46.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:46.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:46.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:46.592 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:56:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:56:47.649 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:56:48.304 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:56:48.853 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:56:49.216 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:56:50.959 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:56:51.486 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:56:51.662 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:56:51.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:51.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:51.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:51.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:51.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:52.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:52.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:52.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:52.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:52.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:52.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:52.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:56:52.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:56:54.527 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:56:54.527 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:56:54.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:56:54.528 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:56:54.528 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:56:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:56:54.897 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:56:55.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:56:57.559 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:56:57.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:56:57.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:56:57.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:56:57.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:56:57.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:56:57.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:56:57.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:56:57.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:56:57.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:56:57.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:56:57.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:56:57.908 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:56:57.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:56:57.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:56:57.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:56:58.850 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:57:01.027 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:57:01.156 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:57:01.221 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:57:02.130 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:57:03.858 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:57:04.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:04.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:04.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:04.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:04.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:04.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:04.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:04.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:04.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:04.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:04.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:04.355 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:57:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:57:05.357 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:57:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:57:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:57:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:57:05.358 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:57:06.080 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:57:07.130 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:57:07.511 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:57:09.022 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:09.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:09.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:09.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:09.720 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:09.720 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:57:09.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:09.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:09.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:09.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:09.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:09.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:09.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:09.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:09.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:57:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:57:10.410 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:57:12.600 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:12.655 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:57:13.157 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:13.157 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:57:13.543 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:57:15.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:15.704 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:15.726 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:15.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:15.765 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:15.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:15.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:15.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:15.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:15.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:15.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:15.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:15.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:57:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:57:16.191 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:57:16.351 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:16.352 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:57:18.684 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:57:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:19.582 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:57:19.587 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:19.588 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:57:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:21.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:21.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:21.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:21.875 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:21.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:21.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:21.962 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:21.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:22.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:22.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:22.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:57:22.248 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:57:22.701 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:23.321 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:23.322 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:57:24.714 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:57:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:57:26.852 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:27.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:27.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:27.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:27.455 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:27.455 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:57:27.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:27.499 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:27.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:27.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:27.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:27.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:27.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:27.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:27.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:57:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:57:28.070 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:57:30.099 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:30.294 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:57:30.698 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:30.698 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:57:31.269 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:57:33.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:33.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:33.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:33.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:33.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:33.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:33.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:33.240 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:33.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:33.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:33.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:33.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:33.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:57:33.987 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:33.988 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:57:34.668 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:57:36.133 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:57:36.643 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:37.540 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:37.540 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:57:38.562 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:57:39.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:39.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:39.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:39.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:39.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:39.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:39.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:39.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:39.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:39.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:39.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:39.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:39.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:57:39.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:57:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:40.924 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:40.925 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:57:41.474 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:57:42.086 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:57:43.991 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:44.848 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:44.848 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:57:45.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:57:45.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:45.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:45.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:45.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:45.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:45.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:45.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:45.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:45.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:45.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:45.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:45.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:57:45.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:57:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:47.907 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:47.907 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:57:48.015 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:57:48.521 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:57:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:57:51.245 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:52.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:52.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:52.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:52.325 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:52.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:52.326 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:57:52.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:52.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:52.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:52.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:52.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:52.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:52.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:52.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:52.536 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.536 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.536 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.537 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.538 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.538 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.538 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:57:52.538 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:57:54.084 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:57:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:55.227 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:57:55.283 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:55.284 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:57:57.989 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:57:58.088 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:57:58.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:57:58.555 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:57:58.590 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:57:58.591 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-22T23:57:58.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:57:58.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:57:58.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:57:58.672 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:57:58.699 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:57:58.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:57:58.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:57:58.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:57:58.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:57:58.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:57:58.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.831 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:57:58.832 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:58:00.974 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:58:01.001 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:58:01.631 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:58:01.682 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:58:01.683 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-22T23:58:04.530 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:58:05.049 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:58:05.141 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:58:05.141 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-22T23:58:05.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:05.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:05.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:05.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:05.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:05.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:05.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:58:05.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:58:05.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:58:05.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:58:05.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:58:05.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:58:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:58:05.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:58:07.580 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:58:07.653 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:58:08.092 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:58:08.265 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:58:08.265 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-22T23:58:11.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:11.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:11.137 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:11.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:11.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:11.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:11.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:58:11.293 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:58:11.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:58:11.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:58:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:58:11.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:58:11.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:58:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:58:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:58:12.186 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:58:12.187 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-22T23:58:14.368 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:58:14.467 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:58:14.648 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:58:14.943 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:58:14.944 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-22T23:58:17.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:17.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:17.666 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:17.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:17.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:17.746 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:17.793 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:58:17.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:58:17.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:58:17.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:58:17.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:58:17.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:58:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.976 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.976 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.976 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.976 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.976 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.976 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:58:17.976 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:58:18.293 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:58:18.923 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:58:18.923 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-22T23:58:18.948 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:58:20.545 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:58:21.193 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:58:21.598 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:58:21.989 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:58:21.990 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-22T23:58:23.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:23.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:23.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:23.844 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:23.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:23.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:23.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:58:23.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:58:24.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:58:24.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:58:24.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:58:24.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:58:24.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.142 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.143 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:58:24.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:58:25.339 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:58:25.756 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:58:25.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:58:25.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-22T23:58:27.078 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:58:28.138 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:58:28.322 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:58:28.931 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:58:28.931 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-22T23:58:29.893 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:29.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:29.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:29.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:30.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:58:30.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:58:30.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:58:30.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:58:30.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:58:30.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:58:30.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.153 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.153 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.153 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.153 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:58:30.153 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:58:31.990 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:58:31.990 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:58:31.991 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:58:31.991 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:58:32.619 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-22T23:58:32.780 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:58:33.231 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:58:35.263 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:58:35.459 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:58:35.460 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:58:35.460 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:58:35.460 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:58:35.460 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:58:35.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:35.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:35.758 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:35.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:35.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:35.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:58:35.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:58:35.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:58:35.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:58:35.942 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:58:35.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:58:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:58:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:58:36.280 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-22T23:58:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:58:38.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:58:38.852 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:58:39.791 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-22T23:58:41.540 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:58:41.798 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:41.821 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:41.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:41.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:41.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:41.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:41.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:58:41.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:58:42.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:58:42.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:58:42.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:58:42.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:58:42.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.085 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.085 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.085 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:58:42.286 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:58:42.286 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:58:42.286 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-22T23:58:42.286 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:58:43.334 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-22T23:58:45.022 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:58:45.054 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:58:45.698 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:58:45.699 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:58:45.699 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:58:45.699 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:58:45.699 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:58:46.524 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-22T23:58:47.676 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:58:47.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:47.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:47.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:47.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:47.875 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:47.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:47.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:58:47.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:58:48.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:58:48.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:58:48.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:58:48.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:58:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:58:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:58:49.556 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:58:50.345 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-22T23:58:51.062 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:58:51.091 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:58:52.777 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:58:53.587 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-22T23:58:53.770 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:58:54.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:54.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:54.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:54.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:54.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:54.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:54.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:58:54.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:58:54.361 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:58:54.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:58:54.418 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:58:54.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:58:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:58:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:58:56.361 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:58:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:58:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:58:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:58:56.361 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:58:56.974 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-22T23:58:57.220 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:58:57.556 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:58:59.754 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:58:59.754 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:58:59.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:58:59.754 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:58:59.754 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:58:59.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:58:59.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:58:59.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:58:59.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:58:59.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:58:59.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:58:59.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:00.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:00.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:00.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:00.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:00.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:00.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:59:00.328 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-22T23:59:00.576 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:59:02.761 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:59:02.930 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-22T23:59:03.591 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:59:03.596 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-22T23:59:06.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:06.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:06.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:06.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:06.267 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:59:06.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:06.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:06.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:06.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:06.398 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:59:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-22T23:59:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-22T23:59:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-22T23:59:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:59:06.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:06.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:06.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:06.478 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.478 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:59:06.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:59:07.334 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-22T23:59:09.497 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:59:09.853 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:59:09.901 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-22T23:59:09.901 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-22T23:59:09.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-22T23:59:09.902 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-22T23:59:09.902 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-22T23:59:10.918 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-22T23:59:12.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:12.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:12.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:12.463 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:12.489 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:12.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:12.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:12.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:12.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:12.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:12.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:12.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:59:12.763 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:59:13.211 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:13.859 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:13.859 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-22T23:59:15.376 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:59:15.884 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:59:17.535 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:18.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:18.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:18.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:18.122 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:18.122 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-22T23:59:18.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:18.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:18.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:18.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:18.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:18.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:18.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:18.308 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:18.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:59:18.723 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:59:20.911 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:21.055 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:59:21.582 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:21.582 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-22T23:59:23.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:23.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:23.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:23.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:23.705 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:23.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:23.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:23.779 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:23.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:23.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:23.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:23.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:23.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:23.908 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.908 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:59:23.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:59:24.501 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:24.502 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-22T23:59:26.426 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:26.689 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:59:26.980 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:26.980 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-22T23:59:29.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:29.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:29.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:29.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:29.177 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:29.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:29.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:29.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:29.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:29.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:29.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:29.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:29.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.364 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:59:29.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:59:30.013 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:30.013 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-22T23:59:32.039 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:32.185 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:59:32.590 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:59:32.779 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:32.779 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-22T23:59:34.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:34.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:34.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:34.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:34.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:34.971 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:34.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:35.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:35.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:35.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:35.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:35.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:35.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:59:35.564 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:59:35.631 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:36.141 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:36.141 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-22T23:59:37.726 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:59:38.614 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-22T23:59:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:39.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:39.775 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-22T23:59:40.371 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:40.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:40.418 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:40.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:40.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:40.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:40.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:40.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:40.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:40.647 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:40.673 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:40.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:59:40.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:59:41.579 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-22T23:59:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:42.781 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:42.781 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-22T23:59:43.511 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:59:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-22T23:59:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:46.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:46.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:46.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:46.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:46.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:46.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:46.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:46.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:46.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:46.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:46.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:46.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:59:46.570 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:46.571 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-22T23:59:46.978 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-22T23:59:49.046 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-22T23:59:49.195 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:49.676 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-22T23:59:50.031 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:50.031 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-22T23:59:52.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:52.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:52.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:52.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:52.471 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:52.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:52.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:52.529 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-22T23:59:52.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:52.571 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:52.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:52.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:52.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:52.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-22T23:59:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-22T23:59:53.351 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:53.352 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-22T23:59:55.587 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-22T23:59:55.785 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-22T23:59:56.535 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-22T23:59:56.535 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-22T23:59:56.632 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-22T23:59:58.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-22T23:59:58.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-22T23:59:58.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-22T23:59:58.761 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-22T23:59:58.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-22T23:59:58.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-22T23:59:58.854 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-22T23:59:58.883 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-22T23:59:58.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-22T23:59:58.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-22T23:59:58.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-22T23:59:58.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-22T23:59:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-22T23:59:58.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-22T23:59:59.367 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-22T23:59:59.474 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:00.060 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:00.061 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:00:01.562 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:00:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:02.605 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:00:02.964 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:02.965 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:00:04.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:04.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:04.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:04.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:04.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:04.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:04.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:04.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:04.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:04.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:04.612 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:04.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:00:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:00:05.576 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:00:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:06.265 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:06.266 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:00:07.192 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:00:09.350 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:09.855 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:00:09.982 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:09.983 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:00:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:10.564 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:10.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:10.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:10.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:10.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:10.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:10.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:10.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:10.838 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:10.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:10.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:00:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:00:12.434 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:12.519 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:00:13.002 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:13.003 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:00:13.668 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:00:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:00:16.098 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:16.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:16.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:16.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:16.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:17.016 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:17.017 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:00:17.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:17.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:17.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:17.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:17.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:17.294 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:17.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:00:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:00:18.851 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:00:19.160 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:19.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:19.905 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:00:20.096 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:00:22.607 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:00:22.869 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:23.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:23.408 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:23.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:23.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:23.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:23.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:23.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:23.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:23.592 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:23.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:23.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:23.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:00:23.726 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:23.727 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:00:25.560 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:00:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:26.147 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:00:26.496 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:26.497 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:00:28.862 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:00:29.272 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:29.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:29.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:29.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:29.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:29.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:29.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:29.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:29.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:29.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:29.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:00:29.993 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:00:30.514 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:00:30.514 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:00:31.590 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:00:32.063 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:00:32.835 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:00:32.835 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:00:32.835 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:00:32.835 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:00:34.150 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:00:34.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:35.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:35.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:35.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:35.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:35.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:35.158 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:35.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:35.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:35.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:35.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:35.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:00:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:00:36.908 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:00:37.468 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:00:38.233 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:00:38.538 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:00:40.634 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:00:41.576 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:00:41.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:41.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:41.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:41.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:41.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:41.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:41.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:41.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:41.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:41.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:41.942 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:41.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:41.969 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.969 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.969 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.969 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:00:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:00:42.618 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:00:43.956 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:00:43.957 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:00:43.957 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:00:43.957 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:00:44.554 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:00:44.659 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:00:45.404 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:00:47.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:47.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:47.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:47.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:47.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:47.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:47.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:47.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:47.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:47.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:47.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:47.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:47.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:00:47.710 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:00:48.301 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:00:48.925 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:00:49.889 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:00:50.314 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:00:51.099 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:00:51.918 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:00:52.522 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:00:52.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:52.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:52.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:52.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:52.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:52.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:52.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:52.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:52.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:53.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:53.041 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:53.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:53.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:00:53.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:00:54.661 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:00:54.661 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:00:54.661 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:00:54.661 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:00:55.312 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:00:55.895 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:00:56.658 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:00:58.160 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:00:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:00:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:00:58.160 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:00:58.160 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:00:58.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:00:58.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:00:58.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:00:58.789 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:00:58.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:00:58.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:00:58.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:00:58.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:00:58.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:00:58.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:00:58.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:00:58.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:00:59.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:00:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:00:59.255 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:01:01.570 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:01:01.684 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:01:02.227 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:01:02.636 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:01:04.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:01:04.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:01:04.675 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:01:04.699 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:01:04.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:01:04.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:01:04.780 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:01:04.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:01:04.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:01:04.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:01:04.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:01:04.911 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:01:04.913 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.913 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.913 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.913 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.913 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:01:04.925 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:01:04.925 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:01:04.925 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:01:04.925 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:01:05.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:01:05.857 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:01:07.672 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:01:08.293 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:01:08.293 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:01:08.293 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:01:08.293 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:01:08.294 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:01:08.857 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:01:08.998 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:01:10.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:01:10.471 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:01:10.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:01:10.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:01:10.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:01:10.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:01:10.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:01:10.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:01:10.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:01:10.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:01:10.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:01:10.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:01:10.864 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.864 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.864 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:01:10.866 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:01:11.779 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:01:11.905 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:01:12.511 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:01:13.580 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:01:14.876 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:01:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:16.170 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:16.170 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:01:16.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:01:16.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:01:16.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:01:16.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:01:16.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:01:16.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:01:16.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:01:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:01:16.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:01:17.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:01:17.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:01:17.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:01:17.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:01:17.685 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:01:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:19.070 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:19.071 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:01:19.868 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:01:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:01:21.813 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:22.571 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:22.572 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:01:22.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:01:23.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:01:23.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:01:23.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:01:23.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:01:23.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:01:23.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:01:23.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:01:23.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:01:23.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:01:23.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:01:23.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:01:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:01:23.728 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:01:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:25.912 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:25.912 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:01:26.127 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:01:26.847 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:01:28.679 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:29.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:01:29.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:01:29.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:01:29.281 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:29.282 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:01:29.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:01:29.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:01:29.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:01:29.368 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:01:29.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:01:29.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:01:29.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:01:29.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:01:29.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:01:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:01:29.975 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:01:31.754 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:32.276 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:32.276 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:01:32.288 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:01:33.871 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:01:35.011 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:35.622 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:35.623 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:01:35.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:01:35.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:01:35.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:01:35.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:01:35.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:01:35.818 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:01:35.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:01:35.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:01:35.907 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:01:35.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:01:35.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:01:35.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:01:35.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.991 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.991 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:01:35.991 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:01:36.653 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:01:37.844 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:38.661 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:01:38.730 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:38.730 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:01:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:01:41.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:01:41.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:01:41.453 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:01:41.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:01:41.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:01:41.533 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:01:41.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:01:41.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:01:41.599 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:41.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:01:41.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:01:41.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:01:41.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:01:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:01:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:01:42.320 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:42.321 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:01:42.963 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:01:44.480 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:01:44.619 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:45.110 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:45.111 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:01:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:01:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:48.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:48.545 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:01:49.699 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:01:50.415 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:51.001 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:51.001 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:01:53.047 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:53.567 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:53.568 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:01:53.659 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:01:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:56.169 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:01:56.205 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:56.205 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:01:57.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:01:57.971 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:01:58.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:01:58.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:01:58.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:01:58.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:01:58.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:01:58.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:01:58.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:01:58.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:01:58.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:01:58.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:01:58.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.265 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.267 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:01:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:01:58.747 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:01:59.517 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:01:59.518 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:02:00.807 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:02:01.364 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:02:01.545 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:02:02.364 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:02:02.365 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:02:04.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:02:04.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:02:04.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:02:04.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:02:04.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:02:04.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:02:04.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:02:04.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:02:04.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:02:04.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:02:04.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:02:04.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:02:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:02:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:02:05.106 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:02:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:02:05.962 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:02:05.963 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:02:07.290 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:02:07.817 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:02:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:02:08.853 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:02:08.853 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:02:10.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:02:10.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:02:10.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:02:10.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:02:10.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:02:10.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:02:10.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:02:10.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:02:10.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:02:10.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:02:10.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:02:10.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:02:10.800 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.801 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:02:10.802 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:02:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:02:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:02:12.386 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:02:12.386 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:02:13.382 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:02:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:02:14.842 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:02:15.518 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:02:15.519 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:02:16.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:02:16.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:02:16.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:02:16.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:02:16.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:02:16.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:02:16.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:02:16.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:02:16.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:02:16.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:02:16.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:02:16.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:02:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:02:16.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:02:18.318 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:02:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:02:18.929 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:02:18.929 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:02:19.484 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:02:21.301 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:02:21.399 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:02:21.953 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:02:21.953 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:02:22.734 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:02:22.734 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:02:22.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:02:22.773 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:02:22.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:02:22.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:02:22.857 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:02:22.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:02:22.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:02:22.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:02:22.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:02:22.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:02:22.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:02:22.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:02:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:02:25.316 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:02:25.316 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:02:25.679 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:02:26.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:02:27.929 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:02:28.467 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:02:28.467 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:02:28.490 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:02:28.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:02:29.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:02:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:02:29.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:02:29.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:02:29.130 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:02:29.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:02:29.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:02:29.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:02:29.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:02:29.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:02:29.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:02:29.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:02:29.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:02:31.538 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:02:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:02:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:02:31.539 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:02:31.714 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:02:32.144 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:02:32.149 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:02:34.520 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:02:34.767 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:02:34.768 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:02:34.768 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:02:34.768 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:02:34.768 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:02:35.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:02:35.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:02:35.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:02:35.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:02:35.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:02:35.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:02:35.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:02:35.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:02:35.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:02:35.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:02:35.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:02:35.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:02:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:02:35.609 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:02:38.105 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:02:38.199 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:02:38.761 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:02:38.956 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:02:41.454 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:02:41.584 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:02:41.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:02:41.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:02:42.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:02:42.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:02:42.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:02:42.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:02:42.136 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:02:42.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:02:42.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:02:42.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:02:42.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:02:42.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:02:42.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:02:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:02:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:02:44.933 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:02:44.933 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:02:44.933 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:02:44.934 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:02:44.934 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:02:45.105 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:02:45.166 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:02:45.726 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:02:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:02:47.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:02:48.000 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:02:48.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:02:48.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:02:48.051 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:02:48.075 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:02:48.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:02:48.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:02:48.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:02:48.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:02:48.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:02:48.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:02:48.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:02:48.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:02:48.868 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:02:51.288 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:02:51.381 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:02:52.102 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:02:52.130 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:02:54.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:02:54.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:02:54.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:02:54.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:02:54.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:02:54.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:02:54.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:02:54.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:02:54.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:02:54.514 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:02:54.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:02:54.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:02:54.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:02:54.779 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:02:55.140 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:02:55.140 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:02:55.140 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:02:55.141 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:02:55.141 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:02:55.826 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:02:57.244 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:02:58.669 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:02:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:02:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:02:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:02:58.670 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:02:58.715 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:02:59.602 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:03:00.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:00.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:00.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:00.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:00.412 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:00.439 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:00.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:00.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:00.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:00.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:00.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:00.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:00.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:03:00.625 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:03:01.919 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:03:02.021 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:03:02.674 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:03:03.441 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:03:05.215 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:03:05.437 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:03:06.356 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:03:06.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:06.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:06.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:06.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:06.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:06.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:06.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:06.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:06.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:06.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:07.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:07.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:07.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.042 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:03:07.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:03:08.086 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:03:08.717 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:03:08.717 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:03:08.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:03:08.718 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:03:08.718 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:03:09.446 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:03:09.889 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:03:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:03:12.658 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:12.659 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:03:13.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:13.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:13.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:13.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:13.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:13.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:13.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:13.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:13.574 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:13.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:13.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:13.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:03:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:03:14.926 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:03:15.047 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:15.672 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:15.673 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:03:16.482 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:03:18.606 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:19.130 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:03:19.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:19.264 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:19.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:19.337 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:19.338 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:03:19.342 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:19.371 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:19.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:19.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:19.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:19.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:19.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:19.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:19.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:03:19.588 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:03:21.576 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:21.687 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:03:22.184 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:22.184 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:03:22.271 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:03:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:25.109 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:03:25.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:25.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:25.678 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:25.679 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:03:25.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:25.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:25.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:25.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:25.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:25.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:25.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:25.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:25.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:26.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:26.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.006 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.006 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.006 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.006 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:03:26.006 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:03:28.081 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:03:28.092 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:28.669 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:28.670 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:03:28.694 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:03:31.484 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:32.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:32.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:32.123 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:03:32.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:32.166 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:32.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:32.167 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:03:32.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:32.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:32.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:32.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:32.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:32.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:32.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:32.387 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:32.388 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.388 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.388 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.388 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.389 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.389 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.389 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.389 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.389 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:03:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:03:34.542 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:34.589 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:03:35.153 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:35.154 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:03:35.207 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:03:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:03:38.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:38.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:38.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:38.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:38.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:38.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:38.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:38.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:38.385 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:38.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:38.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:38.450 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:38.481 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:03:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:03:39.510 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:39.510 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:03:40.823 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:03:41.334 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:03:41.562 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:42.725 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:42.726 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:03:44.041 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:03:44.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:44.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:44.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:44.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:44.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:44.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:44.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:44.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:44.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:44.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:44.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:44.820 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:03:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:03:45.533 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:46.056 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:46.056 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:03:46.801 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:03:47.652 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:03:48.438 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:49.243 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:49.243 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:03:50.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:50.899 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:50.942 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:50.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:51.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:51.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:51.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:03:51.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:51.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:51.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:51.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:51.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:03:51.633 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:52.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:52.371 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:03:53.712 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:03:54.210 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:03:54.343 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:55.193 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:55.194 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:03:57.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:03:57.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:03:57.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:03:57.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:03:57.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:03:57.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:03:57.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:03:57.738 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:03:57.757 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:03:57.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:03:57.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:03:57.840 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:03:57.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:03:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:03:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:03:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:03:59.075 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:03:59.076 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:04:00.381 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:04:00.890 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:04:01.174 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:04:01.987 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:04:01.988 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:04:04.000 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:04:04.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:04:04.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:04:04.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:04:04.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:04:04.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:04:04.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:04:04.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:04:04.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:04:04.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:04:04.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:04:04.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:04:04.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:04:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:04:04.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:04:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:04:06.200 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:04:06.200 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:04:06.837 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:04:07.364 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:04:09.187 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:04:10.139 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:04:10.140 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:04:10.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:04:10.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:04:10.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:04:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:04:10.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:04:10.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:04:10.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:04:10.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:04:10.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:04:10.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:04:10.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:04:10.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:04:10.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.800 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:04:10.800 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:04:11.130 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:04:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:04:13.285 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:04:13.286 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:04:13.569 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:04:14.007 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:04:16.534 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:04:16.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:04:16.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:04:16.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:04:16.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:04:16.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:04:16.904 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:04:16.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:04:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:04:17.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:04:17.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:04:17.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:04:17.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:04:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:04:17.250 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:04:17.250 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:04:17.747 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:04:19.386 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:04:19.665 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:04:19.988 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:04:19.989 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:04:20.435 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:04:22.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:04:22.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:04:22.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:04:22.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:04:22.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:04:22.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:04:22.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:04:22.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:04:22.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:04:22.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:04:22.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:04:22.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:04:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:04:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:04:23.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:04:23.710 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:04:25.129 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:04:25.419 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:04:25.780 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:04:26.612 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:04:26.612 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:04:27.928 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:04:28.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:04:28.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:04:28.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:04:28.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:04:28.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:04:28.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:04:28.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:04:28.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:04:28.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:04:28.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:04:28.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:04:28.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:04:28.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.700 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:04:28.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:04:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:04:30.712 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:04:30.712 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:04:31.365 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:04:31.411 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:04:33.531 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:04:33.972 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:04:34.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:04:34.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:04:34.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:04:34.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:04:34.276 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:04:34.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:04:34.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:04:34.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:04:34.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:04:34.399 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:04:34.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:04:34.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:04:34.481 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:04:34.482 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:04:34.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:04:36.876 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:04:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:04:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:04:36.876 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:04:36.876 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:04:37.254 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:04:37.464 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:04:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:04:40.280 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:04:40.281 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:04:40.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:04:40.281 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:04:40.281 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:04:40.811 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:04:40.865 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:04:43.378 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:04:43.378 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:04:43.379 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:04:43.379 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:04:43.741 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:04:43.902 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:04:45.911 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:04:45.911 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:04:45.912 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:04:45.912 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:04:45.912 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:04:46.276 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:04:46.438 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:04:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:04:48.889 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:04:48.889 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:04:48.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:04:48.889 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:04:48.890 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:04:49.606 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:04:50.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:04:50.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:04:50.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:04:50.301 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:04:50.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:04:50.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:04:50.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:04:50.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:04:50.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:04:50.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:04:50.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:04:50.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:04:50.531 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:04:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:04:51.432 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:04:51.843 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:04:52.645 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:04:53.317 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:04:54.739 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:04:55.292 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:04:55.994 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:04:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:04:56.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:04:56.439 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:04:56.462 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:04:56.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:04:56.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:04:56.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:04:56.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:04:56.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:04:56.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:04:56.733 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:04:56.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:04:56.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:04:56.763 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:04:57.759 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:04:58.332 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:04:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:04:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:04:58.332 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:04:58.332 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:04:59.021 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:04:59.558 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:05:00.769 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:05:01.884 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:05:01.885 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:05:01.885 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:05:01.885 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:05:02.486 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:05:02.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:02.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:03.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:03.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:03.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:03.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:03.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:03.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:03.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:03.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:03.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:03.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:05:03.488 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:05:05.240 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:05:05.968 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:05:06.251 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:05:06.847 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:05:08.586 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:05:08.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:08.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:08.962 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:08.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:09.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:09.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:09.074 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:09.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:09.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:09.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:09.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:09.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:09.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.220 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.222 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.222 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.222 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:05:09.229 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:05:09.892 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:05:11.778 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:05:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:12.468 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:12.468 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:05:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:05:14.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:15.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:15.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:15.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:15.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:15.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:15.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:15.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:15.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:15.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:15.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:15.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:05:15.645 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:15.646 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:05:16.482 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:05:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:18.004 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:05:18.539 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:18.539 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:05:19.808 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:05:21.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:21.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:21.093 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:21.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:21.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:21.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:21.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:21.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:21.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:21.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:21.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:21.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:05:21.790 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:21.791 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:05:22.549 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:05:24.117 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:24.173 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:05:24.640 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:24.640 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:05:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:05:27.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:27.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:27.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:27.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:27.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:27.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:27.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:27.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:27.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:27.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:27.490 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:27.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:27.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:05:27.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:05:28.154 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:28.154 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:05:28.351 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:05:30.304 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:05:30.479 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:31.147 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:05:31.306 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:31.306 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:05:33.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:33.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:33.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:33.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:33.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:33.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:33.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:33.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:33.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:33.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:33.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:33.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:33.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:05:33.837 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:05:33.927 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:34.810 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:34.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:05:36.332 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:05:37.725 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:37.752 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:05:38.333 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:38.334 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:05:39.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:39.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:39.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:39.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:39.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:39.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:39.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:39.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:39.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:39.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:39.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:39.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:39.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:05:39.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:05:40.648 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:05:40.753 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:41.364 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:41.364 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:05:42.154 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:05:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:05:45.264 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:45.264 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:05:45.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:45.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:45.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:45.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:45.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:45.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:45.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:45.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:45.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:45.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:45.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:45.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:45.927 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.928 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.928 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.928 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:05:45.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:05:46.947 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:05:47.605 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:48.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:48.211 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:05:48.791 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:05:50.226 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:05:50.839 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:51.530 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:51.531 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:05:51.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:51.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:51.975 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:51.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:52.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:52.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:52.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:52.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:52.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:52.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:52.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:52.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:05:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:05:53.286 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:05:53.887 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:54.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:54.546 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:05:55.079 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:05:55.792 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:05:57.412 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:05:57.908 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:05:57.908 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:05:58.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:05:58.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:05:58.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:05:58.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:05:58.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:05:58.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:05:58.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:05:58.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:05:58.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:05:58.755 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:05:58.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:05:58.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:05:58.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:05:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:05:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:06:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:06:01.223 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:06:01.224 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:06:01.713 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:06:02.780 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:06:03.898 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:06:04.434 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:06:04.435 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:06:04.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:04.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:05.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:05.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:05.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:05.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:05.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:05.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:05.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:05.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:05.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:05.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:06:05.521 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:06:07.234 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:06:07.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:06:07.851 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:06:08.227 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:06:08.798 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:06:10.623 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:06:11.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:11.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:11.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:11.244 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:06:11.245 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:06:11.246 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:11.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:11.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:11.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:11.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:11.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:11.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:11.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:11.453 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:06:11.710 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:06:14.061 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:06:14.181 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:06:14.663 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:06:14.664 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:06:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:06:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:17.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:17.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:17.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:17.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:17.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:17.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:17.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:17.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:17.250 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:06:17.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:17.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:17.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:06:17.973 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:06:17.973 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:06:18.629 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:06:20.010 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:06:20.127 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:06:20.804 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:06:20.805 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:06:22.163 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:06:23.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:23.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:23.534 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:23.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:23.572 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:06:23.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:23.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:23.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:23.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:23.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:23.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:23.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:23.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:23.770 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:06:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:06:24.166 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:06:24.167 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:06:25.083 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:06:26.284 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:06:26.505 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:06:27.092 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:06:27.093 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:06:28.866 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:06:29.410 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:29.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:29.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:29.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:29.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:29.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:29.612 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:29.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:29.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:29.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:06:29.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:06:30.283 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:06:30.800 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:06:31.736 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:06:32.317 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:06:33.213 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:06:34.102 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:06:34.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:34.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:34.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:35.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:35.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:35.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:35.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:35.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:35.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:35.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:35.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:35.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:35.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:06:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:06:36.912 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:06:36.913 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:06:36.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:06:36.913 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:06:36.913 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:06:37.445 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:06:38.082 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:06:38.689 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:06:40.303 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:06:40.303 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:06:40.304 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:06:40.304 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:06:41.036 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:06:41.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:41.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:41.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:41.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:41.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:41.530 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:41.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:41.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:41.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:41.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:41.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:06:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:06:42.792 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:06:43.638 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:06:44.139 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:06:44.325 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:06:45.538 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:06:47.101 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:06:47.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:47.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:47.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:47.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:47.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:47.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:47.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:47.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:47.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:47.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:47.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:47.866 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:47.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.869 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.869 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.869 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.869 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:06:47.999 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:06:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:06:50.459 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:06:50.459 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:06:50.459 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:06:50.460 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:06:50.573 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:06:50.947 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:06:52.498 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:06:53.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:53.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:53.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:53.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:53.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:53.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:53.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:53.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:53.252 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:06:53.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:53.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:53.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:53.341 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:53.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:06:53.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:06:54.021 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:06:55.819 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:06:56.162 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:06:56.381 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:06:57.006 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:06:58.495 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:06:59.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:06:59.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:06:59.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:06:59.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:06:59.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:06:59.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:06:59.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:06:59.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:06:59.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:06:59.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:06:59.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:06:59.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:06:59.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:06:59.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:07:00.197 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:07:00.197 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:07:00.197 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:07:00.197 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:07:00.979 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:07:01.856 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:07:02.307 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:07:03.394 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:07:03.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:07:03.394 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:07:03.394 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:07:03.394 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:07:04.283 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:07:04.666 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:07:04.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:04.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:04.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:04.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:04.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:05.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:05.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:05.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:05.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:05.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:05.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:05.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:05.174 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.174 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.174 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.174 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:07:05.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:07:07.095 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:07:07.688 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:07:08.160 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:07:08.181 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:07:10.152 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:10.804 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:10.804 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:07:10.824 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:07:11.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:11.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:11.235 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:11.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:11.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:11.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:11.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:11.371 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:11.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:11.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:11.467 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:11.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:07:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:07:13.931 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:07:14.064 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:14.681 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:07:14.834 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:14.834 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:07:16.647 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:07:17.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:17.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:17.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:17.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:17.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:17.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:17.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:17.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:17.246 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:17.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:17.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:17.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:07:17.781 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:17.782 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:07:19.985 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:07:20.228 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:20.476 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:07:20.967 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:20.968 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:07:22.606 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:07:23.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:23.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:23.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:23.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:23.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:23.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:23.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:23.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:23.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:23.315 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:23.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:23.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:23.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:23.393 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.393 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.393 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:07:23.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:07:24.042 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:24.048 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:07:25.823 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:07:26.391 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:07:26.497 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:27.009 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:27.010 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:07:28.447 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:07:29.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:29.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:29.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:29.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:29.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:29.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:29.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:29.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:29.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:29.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:29.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:29.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:29.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:07:29.332 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:30.495 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:30.496 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:07:31.843 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:07:32.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:07:33.028 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:33.868 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:33.869 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:07:34.532 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:07:34.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:34.727 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:34.748 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:34.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:34.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:34.834 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:34.861 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:34.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:34.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:34.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:34.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:34.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:07:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:07:36.989 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:37.616 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:37.616 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:07:37.876 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:07:37.956 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:07:40.437 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:40.561 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:07:40.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:40.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:41.006 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:41.007 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:07:41.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:41.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:41.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:41.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:41.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:41.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:41.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:41.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:41.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:41.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:41.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.262 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.262 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.262 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.262 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.262 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:07:41.262 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:07:43.721 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:43.913 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:07:44.056 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:07:44.323 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:44.323 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:07:46.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:46.683 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:46.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:46.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:46.753 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:07:46.757 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:46.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:46.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:46.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:46.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:46.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:46.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:46.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:46.980 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:07:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:07:47.407 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:47.408 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:07:49.887 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:07:50.036 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:50.796 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:50.796 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:07:50.936 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:07:52.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:52.913 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:52.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:52.969 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:53.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:53.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:53.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:53.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:53.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:53.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:53.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:53.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:53.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.260 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:07:53.505 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:53.844 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:07:54.300 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:54.301 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:07:55.861 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:07:56.685 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:07:57.226 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:07:57.725 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:07:57.726 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:07:58.458 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:07:58.481 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:07:58.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:07:58.538 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:07:58.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:07:58.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:07:58.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:07:58.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:07:58.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:07:58.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:07:58.760 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:07:58.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:07:58.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:07:58.798 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:07:59.977 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:08:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:08:00.919 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:08:00.919 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:08:01.754 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:08:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:08:03.841 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:08:04.769 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:08:04.770 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:08:05.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:08:05.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:08:05.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:08:05.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:08:05.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:08:05.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:08:05.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:08:05.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:08:05.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:08:05.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:08:05.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:08:05.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:08:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:08:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:08:06.621 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:08:07.038 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:08:07.866 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:08:07.866 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:08:08.475 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:08:09.867 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:08:10.519 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:08:11.270 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:08:11.270 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:08:11.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:08:11.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:08:11.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:08:11.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:08:11.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:08:11.818 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:08:11.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:08:11.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:08:11.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:08:11.926 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:08:11.954 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:08:11.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:08:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:08:11.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:08:13.002 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:08:13.629 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:08:14.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:08:14.258 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:08:14.800 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:08:16.270 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:08:16.972 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:08:17.819 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:08:17.820 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:08:18.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:08:18.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:08:18.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:08:18.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:08:18.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:08:18.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:08:18.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:08:18.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:08:18.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:08:18.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:08:18.361 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:08:18.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:08:18.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:08:18.393 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:08:19.445 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:08:19.995 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:08:20.661 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:08:20.662 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:08:21.199 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:08:22.855 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:08:23.466 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:08:24.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:08:24.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:08:24.187 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:08:24.187 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:08:24.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:08:24.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:08:24.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:08:24.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:08:24.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:08:24.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:08:24.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:08:24.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:08:24.441 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:08:24.467 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:08:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:08:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:08:25.782 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:08:26.302 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:08:26.924 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:08:26.924 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:08:27.269 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:08:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:08:29.870 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:08:29.870 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:08:29.871 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:08:29.871 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:08:30.528 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:08:30.766 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:08:30.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:08:30.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:08:30.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:08:30.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:08:30.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:08:30.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:08:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:08:30.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:08:31.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:08:31.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:08:31.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:08:31.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.060 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:08:31.704 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:08:32.833 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:08:33.689 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:08:33.726 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:08:34.853 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:08:36.543 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:08:36.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:08:36.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:08:36.873 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:08:36.897 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:08:36.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:08:36.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:08:36.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:08:37.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:08:37.029 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:08:37.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:08:37.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:08:37.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:08:37.110 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:08:37.263 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:08:38.103 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:08:39.534 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:08:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:08:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:08:39.535 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:08:39.669 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:08:40.299 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:08:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:08:43.030 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:08:43.030 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:08:43.030 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:08:43.031 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:08:43.031 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:08:43.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:08:43.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:08:43.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:08:43.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:08:43.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:08:43.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:08:43.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:08:43.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:08:43.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:08:43.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:08:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:08:43.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:08:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.599 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:08:43.676 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:08:44.612 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:08:46.097 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:08:46.290 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:08:47.245 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:08:48.036 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:08:48.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:08:48.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:08:48.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:08:49.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:08:49.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:08:49.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:08:49.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:08:49.118 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:08:49.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:08:49.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:08:49.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:08:49.290 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:08:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:08:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:08:50.212 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:08:50.212 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:08:50.212 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:08:50.212 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:08:50.744 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:08:50.765 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:08:51.944 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:08:54.055 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:08:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:08:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:08:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:08:54.056 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:08:54.767 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:08:55.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:08:55.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:08:55.118 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:08:55.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:08:55.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:08:55.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:08:55.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:08:55.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:08:55.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:08:55.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:08:55.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:08:55.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:08:55.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:08:55.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:08:56.900 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:08:57.500 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:08:58.328 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:09:00.090 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:09:00.751 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:09:01.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:01.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:01.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:01.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:01.117 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:01.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:01.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:01.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:01.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:01.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:01.275 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:01.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:01.303 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.303 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.303 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.304 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.304 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.304 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.304 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.304 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.304 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.304 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:09:01.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:09:02.997 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:09:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:09:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:09:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:09:02.998 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:09:03.604 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:09:03.973 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:09:04.178 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:09:06.455 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:09:06.456 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:09:06.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:09:06.456 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:09:06.456 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:09:06.705 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:06.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:06.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:06.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:06.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:06.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:06.863 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:06.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:06.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:06.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:06.995 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:09:07.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:07.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:09:07.076 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:09:09.504 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:09:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:09:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:11.178 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:11.178 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:09:12.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:12.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:12.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:12.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:12.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:12.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:12.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:12.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:12.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:12.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:12.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:12.326 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.326 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.326 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:09:12.879 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:09:13.605 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:14.271 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:14.272 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:09:15.196 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:09:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:09:17.536 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:18.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:18.216 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:09:18.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:18.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:18.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:18.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:18.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:18.447 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:18.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:18.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:18.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:18.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:18.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:18.607 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:09:18.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:09:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:09:20.805 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:21.338 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:09:21.416 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:21.417 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:09:23.718 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:23.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:23.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:23.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:23.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:23.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:23.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:23.910 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:23.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:23.962 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:23.982 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:23.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:24.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:09:24.661 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:24.662 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:09:26.649 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:26.817 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:09:27.234 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:27.234 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:09:29.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:29.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:29.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:29.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:29.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:29.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:29.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:29.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:29.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:29.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:29.605 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:29.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:29.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:29.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.679 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:09:29.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:09:30.290 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:30.291 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:09:32.315 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:32.451 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:09:32.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:32.852 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:09:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:09:35.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:35.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:35.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:35.262 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:35.294 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:35.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:35.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:35.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:35.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:35.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:35.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:35.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:35.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:09:35.738 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:09:36.129 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:36.129 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:09:38.300 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:09:38.808 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:38.908 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:09:39.429 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:39.429 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:09:40.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:40.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:40.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:40.988 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:41.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:41.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:41.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:41.117 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:41.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:41.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:41.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:41.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:41.276 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.276 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.276 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.276 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:09:41.983 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:09:42.224 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:42.957 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:42.957 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:09:43.892 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:09:45.266 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:09:46.025 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:46.577 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:46.578 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:09:47.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:47.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:47.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:47.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:47.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:47.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:47.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:47.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:47.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:47.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:47.342 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:47.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:47.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.373 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.373 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.373 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.373 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.373 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.373 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:09:47.373 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:09:48.022 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:09:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:50.075 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:50.075 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:09:50.190 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:09:50.725 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:09:52.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:52.944 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:52.970 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:52.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:53.005 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:53.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:53.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:53.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:53.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:53.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:53.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:53.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:53.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:53.224 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:09:53.654 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:53.655 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:09:53.681 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:09:56.031 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:09:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:57.106 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:09:57.106 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:09:57.205 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:09:58.566 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:09:58.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:09:58.612 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:09:58.635 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:09:58.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:09:58.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:09:58.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:09:58.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:09:58.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:09:58.793 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:09:58.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:09:58.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:09:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:09:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:09:59.852 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:09:59.967 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:10:00.484 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:10:00.484 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:10:01.461 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:10:03.484 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:10:03.896 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:10:04.085 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:10:04.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:10:05.067 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:10:05.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:10:05.118 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:10:05.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:10:05.168 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:10:05.194 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:10:05.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:10:05.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:10:05.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:10:05.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:10:05.329 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:10:05.355 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:10:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:10:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:10:06.703 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:10:06.715 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:10:07.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:10:07.347 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:10:08.130 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:10:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:10:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:10:11.035 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:10:11.035 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:10:11.471 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:10:11.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:10:11.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:10:11.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:10:11.574 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:10:11.602 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:10:11.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:10:11.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:10:11.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:10:11.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:10:11.750 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:10:11.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:10:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:10:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:10:12.809 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:10:13.403 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:10:14.065 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:10:14.066 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:10:14.609 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:10:16.762 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:10:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:10:17.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:10:17.765 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:10:18.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:10:18.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:10:18.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:10:18.106 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:10:18.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:10:18.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:10:18.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:10:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:10:18.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:10:18.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:10:18.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:10:18.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:10:18.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.431 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:10:18.432 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:10:19.773 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:10:20.056 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:10:20.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:10:20.774 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:10:21.234 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:10:22.902 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:10:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:10:24.434 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:10:24.434 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:10:24.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:10:24.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:10:24.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:10:24.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:10:24.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:10:24.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:10:24.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:10:25.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:10:25.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:10:25.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:10:25.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:10:25.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:10:25.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.127 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.128 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:10:25.935 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:10:26.776 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:10:27.448 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:10:27.449 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:10:27.947 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:10:29.928 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:10:29.992 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:10:29.993 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:10:29.993 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:10:29.993 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:10:30.942 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:10:31.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:10:31.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:10:31.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:10:31.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:10:31.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:10:31.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:10:31.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:10:31.432 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:10:31.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:10:31.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:10:31.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:10:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:10:31.549 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:10:31.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:10:32.889 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:10:33.245 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:10:34.001 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:10:34.186 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:10:36.214 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:10:37.077 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:10:37.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:10:37.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:10:37.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:10:37.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:10:37.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:10:37.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:10:37.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:10:37.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:10:37.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:10:37.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:10:37.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:10:37.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:10:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:10:37.604 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:10:39.052 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:10:39.820 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:10:39.820 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:10:39.820 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:10:39.820 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:10:40.072 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:10:40.490 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:10:43.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:10:43.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:10:43.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:10:43.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:10:43.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:10:43.300 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:10:43.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:10:43.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:10:43.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:10:43.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:10:43.424 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:10:43.438 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:10:43.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:10:43.466 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:10:43.915 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:10:44.163 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:10:46.369 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:10:46.517 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:10:46.718 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:10:46.951 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:10:49.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:10:49.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:10:49.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:10:49.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:10:49.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:10:49.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:10:49.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:10:49.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:10:49.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:10:49.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:10:49.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:10:49.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:10:49.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:10:50.754 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:10:50.754 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:10:50.755 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:10:50.755 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:10:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:10:51.366 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:10:52.463 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:10:53.357 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:10:53.357 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:10:53.357 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:10:53.357 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:10:53.357 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:10:53.750 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:10:54.024 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:10:55.954 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:10:55.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:10:56.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:10:56.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:10:56.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:10:56.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:10:56.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:10:56.130 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:10:56.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:10:56.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:10:56.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:10:56.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:10:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:10:56.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:10:57.359 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:10:57.360 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:10:58.122 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:10:59.058 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:11:00.130 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:11:00.223 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:11:01.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:11:01.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:02.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:02.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:02.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:02.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:02.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:02.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:02.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:02.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:02.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:02.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:02.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:11:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:11:03.929 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:11:04.057 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:11:04.057 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:11:04.058 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:11:04.058 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:11:04.058 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:11:04.881 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:11:05.586 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:11:06.703 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:11:07.362 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:11:07.362 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:11:07.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:11:07.363 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:11:07.363 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:11:08.193 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:11:08.599 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:08.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:08.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:08.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:08.694 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:08.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:08.746 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:08.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:08.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:08.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:08.852 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:08.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:08.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.881 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:11:08.882 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:11:11.153 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:11.213 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:11:11.716 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:11:11.889 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:11.889 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:11:14.096 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:11:14.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:14.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:14.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:14.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:14.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:14.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:14.244 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:14.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:14.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:14.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:14.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:14.371 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:14.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:14.398 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.398 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:11:14.953 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:14.954 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:11:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:11:17.355 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:11:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:18.429 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:18.429 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:11:19.813 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:11:20.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:20.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:20.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:20.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:20.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:20.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:20.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:20.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:20.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:20.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:20.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:20.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:20.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:11:20.592 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:11:21.486 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:22.310 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:22.311 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:11:23.275 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:11:23.942 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:11:24.655 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:25.410 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:25.411 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:11:25.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:25.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:26.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:26.047 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:26.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:26.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:26.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:26.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:26.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:26.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:26.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:26.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:26.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.301 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:11:26.646 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:11:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:28.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:28.905 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:11:29.113 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:11:29.981 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:11:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:31.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:31.852 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:31.875 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:31.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:31.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:31.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:31.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:32.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:32.029 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:32.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:32.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:32.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:11:32.278 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:32.279 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:11:32.950 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:11:34.705 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:11:34.737 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:35.423 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:35.423 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:11:36.221 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:11:37.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:38.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:38.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:38.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:38.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:38.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:38.128 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:38.154 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:38.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:38.186 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:38.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:38.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:38.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:38.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.290 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.290 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.290 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:11:38.908 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:38.909 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:11:39.257 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:11:41.037 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:11:41.388 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:42.209 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:42.209 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:11:42.251 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:11:43.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:43.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:43.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:43.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:43.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:43.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:43.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:43.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:43.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:44.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:44.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:44.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:44.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.104 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.105 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:11:44.106 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:11:45.103 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:11:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:45.781 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:45.781 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:11:46.732 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:11:48.585 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:48.875 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:11:49.277 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:49.277 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:11:50.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:50.068 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:50.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:50.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:50.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:50.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:50.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.366 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.367 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:11:50.368 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:11:51.609 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:51.705 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:11:52.213 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:52.214 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:11:53.197 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:11:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:55.945 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:55.945 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:11:56.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:11:56.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:11:56.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:11:56.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:11:56.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:11:56.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:11:56.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:11:56.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:11:56.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:11:56.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:11:56.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:11:56.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:11:56.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:11:56.381 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:11:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:11:58.714 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:11:58.715 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:11:59.033 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:12:01.045 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:12:01.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:01.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:01.645 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:12:01.646 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:12:01.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:01.693 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:01.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:01.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:01.775 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:01.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:01.852 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:01.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:01.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:12:01.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:12:03.933 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:12:04.498 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:12:04.499 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:12:04.599 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:12:05.238 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:12:07.403 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:12:07.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:07.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:07.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:07.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:07.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:07.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:07.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:07.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:07.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:07.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:07.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:12:07.921 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:12:07.992 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:12:07.992 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:12:10.424 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:12:10.914 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:12:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:12:11.574 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:12:11.575 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:12:13.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:13.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:13.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:13.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:13.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:13.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:13.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:13.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:13.286 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:13.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:13.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:13.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:12:13.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:12:14.159 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:12:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:12:15.348 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:12:15.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:12:16.063 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:12:16.973 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:12:18.428 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:12:19.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:19.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:19.100 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:12:19.101 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:12:19.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:19.155 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:19.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:19.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:19.265 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:19.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:19.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:19.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:19.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:19.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:19.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:12:19.713 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:12:21.900 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:12:22.087 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:12:22.478 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:12:22.478 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:12:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:12:25.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:25.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:25.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:25.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:25.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:25.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:25.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:25.226 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:25.229 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:12:25.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:25.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:25.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.340 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.341 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:12:25.951 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:12:25.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:12:25.979 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:12:28.154 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:12:28.523 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:12:28.984 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:12:29.287 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:12:29.288 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:12:31.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:31.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:31.048 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:31.071 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:31.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:31.124 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:31.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:31.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:31.256 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:31.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.286 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:12:31.842 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:12:32.342 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:12:33.145 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:12:33.953 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:12:35.241 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:12:35.775 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:12:36.595 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:12:36.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:37.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:37.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:37.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:37.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:37.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:37.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:37.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:37.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:37.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:37.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:37.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:37.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:12:37.269 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:12:38.339 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:12:38.753 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:12:38.753 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:12:38.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:12:38.754 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:12:38.754 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:12:39.553 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:12:39.829 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:12:42.240 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:12:42.240 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:12:42.240 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:12:42.241 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:12:42.284 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:12:42.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:42.575 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:42.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:42.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:42.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:42.679 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:42.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:42.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:42.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:42.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:42.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:42.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:42.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:12:42.863 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:12:43.369 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:12:45.051 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:12:45.369 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:12:45.559 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:12:46.069 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:12:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:12:48.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:48.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:48.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:48.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:48.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:48.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:49.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:49.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:49.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:49.088 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:49.118 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:49.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:49.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:12:49.419 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:12:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:12:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:12:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:12:49.420 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:12:50.104 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:12:51.010 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:12:51.768 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:12:52.565 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:12:52.565 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:12:52.565 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:12:52.565 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:12:53.538 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:12:54.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:12:54.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:12:54.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:12:54.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:12:54.911 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:12:54.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:12:54.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:12:55.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:12:55.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:12:55.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:12:55.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:12:55.142 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:12:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:12:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:12:56.525 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:12:57.138 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:12:57.779 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:12:58.024 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:13:00.053 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:13:00.728 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:13:01.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:01.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:01.418 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:01.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:01.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:01.495 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:01.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:01.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:01.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:01.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:01.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:01.664 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:13:01.672 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:01.674 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.675 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:13:01.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:13:03.395 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:13:03.396 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:13:03.396 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:13:03.396 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:13:03.961 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:13:04.600 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:13:04.909 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:13:07.206 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:13:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:13:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:13:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:13:07.207 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:13:07.966 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:13:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:08.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:08.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:08.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:08.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:08.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:08.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:08.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:08.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:08.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:08.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.605 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.607 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:13:08.607 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:13:09.026 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:13:10.451 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:13:11.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:13:11.390 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:13:11.836 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:13:14.139 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:14.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:14.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:14.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:14.785 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:14.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:14.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:14.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:14.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:14.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:14.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:14.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:14.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:14.787 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.787 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.787 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.787 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.787 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.788 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.788 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.788 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.788 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.788 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.788 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.788 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:13:14.985 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:14.986 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:13:16.251 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:13:17.503 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:13:17.562 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:18.249 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:18.249 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:13:18.976 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:13:20.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:20.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:20.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:20.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:20.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:20.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:20.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:20.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:20.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:20.911 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:20.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.914 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:13:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:13:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:22.288 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:13:22.420 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:22.421 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:13:23.929 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:13:24.494 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:24.820 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:13:25.124 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:25.124 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:13:27.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:27.295 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:27.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:27.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:27.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:27.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:27.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:27.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:27.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:27.562 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:27.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:27.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.597 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:13:27.871 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:28.835 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:28.835 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:13:28.871 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:13:30.469 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:13:31.171 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:31.439 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:13:32.021 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:32.022 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:13:33.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:33.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:33.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:33.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:33.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:33.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:33.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:33.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:33.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:33.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:33.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:33.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:33.944 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.945 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:13:33.946 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:13:34.989 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:13:35.136 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:35.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:35.891 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:13:36.873 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:13:37.500 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:13:38.123 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:39.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:39.211 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:13:39.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:39.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:39.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:39.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:40.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:40.106 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:40.132 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:40.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:40.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:40.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.188 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:13:40.189 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:13:41.039 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:13:42.109 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:42.681 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:42.682 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:13:42.951 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:13:43.728 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:13:45.489 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:45.943 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:45.967 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:45.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:46.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:46.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:46.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:46.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:46.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:46.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:46.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:46.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:46.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:13:46.403 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:46.403 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:13:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:13:49.103 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:49.175 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:13:49.691 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:49.692 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:13:50.636 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:13:52.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:52.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:52.202 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:52.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:52.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:52.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:52.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:52.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:52.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:52.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:52.457 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:52.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:52.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.491 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:13:52.586 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:53.274 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:53.274 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:13:53.998 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:13:55.115 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:13:55.482 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:56.189 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:56.189 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:13:56.737 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:13:57.730 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:13:57.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:13:57.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:13:57.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:13:57.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:13:57.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:13:57.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:13:57.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:13:57.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:13:58.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:13:58.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:13:58.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:13:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:13:58.757 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:13:59.499 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:13:59.499 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:14:00.997 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:14:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:14:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:02.464 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:02.465 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:14:03.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:03.782 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:03.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:03.839 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:03.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:03.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:03.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:03.959 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:03.985 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:03.987 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:14:04.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:04.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:04.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:04.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:14:04.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:14:05.043 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:05.648 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:05.649 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:14:06.858 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:14:07.021 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:14:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:09.111 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:09.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:14:09.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:09.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:09.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:09.803 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:14:09.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:09.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:09.875 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:09.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:09.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:09.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:09.991 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:10.019 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:10.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:10.047 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.047 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.047 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.047 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.047 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:14:10.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:14:11.875 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:12.493 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:12.493 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:14:13.071 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:14:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:14:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:15.942 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:15.943 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:14:16.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:16.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:16.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:16.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:16.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:16.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:16.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:16.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:16.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:16.469 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:16.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:16.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:16.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:14:16.527 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:14:17.050 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:14:18.583 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:19.095 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:19.096 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:14:19.659 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:14:20.048 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:14:22.062 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:22.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:22.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:22.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:22.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:22.681 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:22.682 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:14:22.693 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:22.732 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:22.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:22.805 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:22.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:22.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:22.892 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:22.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:14:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:14:23.018 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:14:25.498 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:25.636 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:14:26.273 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:26.274 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:14:26.866 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:14:28.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:28.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:28.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:28.784 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:28.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:28.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:28.844 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:28.863 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:28.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:28.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:28.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:28.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:29.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:14:29.456 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:29.457 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:14:29.966 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:14:31.820 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:14:31.934 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:14:32.689 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:14:32.689 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:14:33.035 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:14:35.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:35.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:35.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:35.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:35.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:35.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:35.209 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:35.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:35.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:35.269 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:14:35.293 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:35.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:35.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:35.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:14:35.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:14:36.054 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:14:36.146 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:14:38.212 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:14:38.936 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:14:39.039 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:14:39.792 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:14:41.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:41.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:41.495 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:41.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:41.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:41.572 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:41.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:41.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:41.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:41.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:41.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:41.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:41.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.741 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.742 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:14:41.922 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:14:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:14:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:14:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:14:41.923 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:14:42.079 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:14:42.666 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:14:44.308 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:14:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:14:44.888 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:14:44.888 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:14:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:14:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:14:45.693 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:14:47.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:47.535 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:47.568 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:47.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:47.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:47.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:47.672 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:47.700 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:47.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:47.751 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:47.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:47.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:47.805 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:14:47.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:14:48.391 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:14:48.430 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:14:49.126 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:14:50.369 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:14:52.104 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:14:52.270 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:14:52.851 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:14:53.294 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:53.316 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:53.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:53.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:53.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:53.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:53.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:53.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:53.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:53.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:53.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:53.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:53.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:14:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:14:55.186 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:14:55.186 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:14:55.186 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:14:55.187 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:14:55.221 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:14:55.773 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:14:56.626 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:14:58.848 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:14:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:14:58.848 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:14:58.849 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:14:58.849 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:14:58.878 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:14:59.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:14:59.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:14:59.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:14:59.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:14:59.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:14:59.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:14:59.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:14:59.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:14:59.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:14:59.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:14:59.373 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:14:59.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:14:59.415 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:14:59.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:15:00.015 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:15:02.017 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:15:02.061 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:15:02.191 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:15:02.643 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:15:05.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:05.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:05.284 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:05.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:05.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:05.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:05.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:05.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:05.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:05.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:05.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:05.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.583 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.583 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.583 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.583 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.583 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.585 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:15:05.659 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:15:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:15:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:15:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:15:06.051 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:15:06.691 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:15:08.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:15:08.682 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:15:08.682 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:15:08.682 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:15:08.682 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:15:08.682 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:15:08.863 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:15:09.624 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:15:11.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:11.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:11.210 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:11.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:11.361 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:11.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:11.423 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:11.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:11.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:11.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:15:11.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:15:12.701 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:15:13.053 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:15:13.316 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:15:14.219 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:15:15.614 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:15.761 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:15:16.436 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:17.467 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:15:17.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:17.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:17.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:17.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:17.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:17.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:17.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:17.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:17.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:17.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:17.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:17.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:17.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.482 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.482 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:15:17.482 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:15:19.078 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:15:20.089 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:15:20.232 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:20.963 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:20.963 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:15:21.858 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:15:22.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:22.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:22.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:22.893 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:22.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:22.947 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:22.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:23.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:23.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:23.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:23.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:23.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:15:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:15:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:25.034 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:25.034 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:15:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:15:26.035 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:15:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:28.185 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:28.186 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:15:28.228 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:15:28.804 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:28.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:28.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:28.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:28.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:28.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:28.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:28.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:29.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:29.044 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:29.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:29.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:15:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:15:31.149 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:31.580 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:15:31.674 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:31.674 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:15:31.903 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:15:34.083 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:15:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:34.753 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:34.753 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:15:34.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:34.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:34.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:34.867 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:34.893 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:34.935 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:34.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:34.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:35.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:35.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:35.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:35.084 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:35.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.087 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:15:35.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:15:37.434 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:38.031 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:38.032 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:15:38.259 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:15:40.382 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:40.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:40.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:40.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:40.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:40.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:40.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:40.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:40.609 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:40.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:40.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:40.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:40.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:40.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:15:40.912 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:40.913 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:15:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:43.226 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:15:43.376 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:43.377 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:15:45.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:45.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:45.605 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:45.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:45.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:45.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:45.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:45.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:45.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:45.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:45.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:45.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:45.934 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:45.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.935 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.936 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.936 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.936 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.936 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.936 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:15:45.936 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:15:46.103 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:46.252 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:15:48.046 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:15:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:48.423 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:15:48.923 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:48.923 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:15:50.704 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:15:51.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:51.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:51.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:51.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:51.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:51.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:51.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:51.251 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:51.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:51.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:51.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:51.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:51.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:51.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.360 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:15:51.920 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:51.920 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:15:54.053 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:15:54.393 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:15:54.575 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:55.033 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:55.034 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:15:56.622 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:15:57.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:15:57.198 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:15:57.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:15:57.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:15:57.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:15:57.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:15:57.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:15:57.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:15:57.422 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:15:57.426 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:15:57.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:15:57.499 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:15:57.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:15:57.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:15:57.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:15:58.103 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:15:58.104 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:16:00.104 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:16:00.655 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:16:01.041 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:01.797 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:01.798 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:16:02.794 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:16:03.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:03.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:03.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:03.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:03.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:03.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:03.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:03.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:03.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:03.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:03.255 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:03.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:03.283 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.284 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:16:03.285 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:16:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:05.298 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:05.299 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:16:06.121 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:16:06.147 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:16:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:08.646 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:08.647 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:16:09.077 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:16:09.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:09.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:09.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:09.768 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:09.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:09.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:09.857 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:09.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:09.914 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:09.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:09.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:09.992 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:09.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.994 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:16:09.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:16:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:12.174 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:12.174 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:16:12.297 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:16:12.783 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:16:14.882 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:16:14.965 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:15.574 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:15.618 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:15.618 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:16:15.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:15.653 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:15.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:15.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:15.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:15.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:15.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:15.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:15.863 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:15.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:15.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:15.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.918 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:16:15.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:16:18.281 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:18.611 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:16:18.884 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:18.884 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:16:18.967 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:16:21.297 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:21.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:21.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:21.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:21.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:21.789 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:21.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:21.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:21.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:21.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:16:22.402 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:22.402 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:16:24.873 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:16:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:25.293 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:16:26.327 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:26.328 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:16:27.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:27.814 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:27.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:27.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:27.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:27.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:27.966 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:28.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:28.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:28.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:28.083 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:28.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:16:28.338 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:16:28.625 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:29.257 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:29.258 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:16:30.760 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:16:31.942 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:16:32.295 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:16:32.833 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:16:32.833 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:16:33.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:33.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:33.541 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:33.564 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:33.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:33.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:33.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:33.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:33.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:33.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:33.765 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:33.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:33.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.793 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:16:33.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:16:35.110 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:16:35.126 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:16:35.750 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:16:36.648 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:16:38.571 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:16:38.886 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:16:39.135 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:16:40.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:40.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:40.102 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:40.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:40.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:40.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:40.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:40.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:40.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:40.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:40.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:40.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:40.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:16:40.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:16:41.646 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:16:41.743 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:16:41.743 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:16:41.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:16:41.744 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:16:41.744 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:16:42.396 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:16:43.259 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:16:44.905 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:16:45.297 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:16:45.329 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:16:45.330 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:16:45.330 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:16:46.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:16:46.463 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:46.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:46.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:46.560 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:46.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:46.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:46.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:46.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:46.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:46.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:46.780 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:46.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:46.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:16:46.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:16:47.572 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:16:48.249 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:16:48.906 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:16:49.702 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:16:51.497 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:16:51.967 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:16:52.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:52.515 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:52.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:52.564 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:52.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:52.620 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:52.646 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:52.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:52.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:52.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:52.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:52.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:16:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:16:54.259 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:16:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:16:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:16:54.260 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:16:54.863 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:16:55.690 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:16:57.463 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:16:57.464 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:16:57.464 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:16:57.464 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:16:57.464 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:16:58.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:16:58.121 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:16:58.144 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:16:58.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:16:58.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:16:58.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:16:58.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:16:58.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:16:58.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:16:58.367 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:16:58.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:16:58.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:16:58.451 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:16:58.452 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.452 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.454 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:16:58.454 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:17:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:17:01.022 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:17:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:17:01.267 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:17:03.668 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:17:03.777 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:17:04.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:04.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:04.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:04.386 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:17:04.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:04.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:04.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:04.503 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:04.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:04.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:04.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:04.614 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:04.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.647 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:17:04.664 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:17:07.129 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:17:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:17:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:17:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:17:07.129 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:17:07.165 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:17:07.453 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:17:07.853 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:17:10.016 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:17:10.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:10.178 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:10.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:10.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:10.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:10.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:10.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:10.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:10.374 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:17:10.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:10.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:10.431 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:10.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:10.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:17:10.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:17:11.700 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:17:13.089 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:17:13.323 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:17:14.886 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:15.453 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:15.453 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:17:15.959 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:17:16.042 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:16.066 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:16.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:16.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:16.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:16.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:16.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:16.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:16.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:16.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:16.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:16.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:16.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.333 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:17:16.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:17:18.088 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:18.695 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:18.695 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:17:19.276 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:17:20.132 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:17:21.392 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:22.063 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:22.063 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:17:22.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:22.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:22.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:22.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:22.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:22.512 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:22.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:22.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:22.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:22.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:22.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.662 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:17:22.664 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:17:23.113 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:17:24.582 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:25.280 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:25.281 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:17:25.520 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:17:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:17:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:28.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:28.466 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:28.484 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:28.486 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:17:28.497 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:28.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:28.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:28.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:28.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:28.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:28.676 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:28.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:28.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:28.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.760 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:17:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:17:29.081 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:17:31.173 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:31.453 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:17:31.805 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:31.806 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:17:32.310 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:17:34.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:34.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:34.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:34.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:34.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:34.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:34.409 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:34.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:34.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:34.467 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:34.487 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:34.513 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:34.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:34.541 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.543 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:17:34.954 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:34.955 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:17:35.178 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:17:37.306 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:17:37.431 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:17:38.255 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:38.255 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:17:40.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:40.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:40.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:40.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:40.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:40.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:40.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:40.441 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:40.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:40.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:40.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:17:40.783 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:17:41.118 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:41.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:41.766 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:17:43.192 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:17:44.132 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:17:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:45.499 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:45.500 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:17:45.953 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:45.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:45.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:46.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:46.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:46.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:46.105 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:46.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:46.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:46.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:46.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:46.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:46.263 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.263 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.263 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.263 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.263 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.263 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:17:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:17:47.251 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:17:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:48.414 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:48.414 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:17:49.013 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:17:50.187 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:17:51.182 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:51.934 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:51.935 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:17:52.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:52.371 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:52.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:52.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:52.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:52.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:52.499 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:52.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:52.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:52.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:52.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:52.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:52.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.636 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:17:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:17:53.403 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:17:54.183 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:54.816 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:54.817 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:17:55.412 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:17:57.131 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:17:57.305 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:17:57.935 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:17:57.936 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:17:58.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:17:58.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:17:58.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:17:58.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:17:58.718 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:17:58.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:17:58.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:17:58.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:17:58.831 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:17:58.851 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:17:58.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:17:58.906 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:17:58.908 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.910 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:17:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:18:00.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:18:00.240 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:00.963 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:00.964 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:18:01.672 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:18:03.904 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:04.169 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:18:04.519 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:04.519 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:18:04.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:04.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:04.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:04.637 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:04.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:04.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:04.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:04.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:04.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:04.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:04.824 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:04.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:04.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.851 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.852 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.853 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.853 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.853 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:18:04.854 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:18:06.945 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:18:06.967 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:07.443 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:18:07.704 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:07.705 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:18:10.255 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:10.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:10.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:10.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:10.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:10.381 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:10.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:10.449 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:10.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:10.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:10.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:10.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:18:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:11.310 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:18:11.507 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:11.507 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:18:13.310 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:18:13.551 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:13.862 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:18:14.256 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:14.257 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:18:16.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:16.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:16.389 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:16.412 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:16.438 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:16.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:16.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:16.519 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:16.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:16.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:16.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:16.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:16.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.630 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:18:16.631 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:18:17.606 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:18.123 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:18:18.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:18.163 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:18:19.378 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:18:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:20.703 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:18:21.254 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:21.255 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:18:22.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:22.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:22.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:22.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:22.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:22.161 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:22.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:22.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:22.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:22.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:22.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:22.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.329 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.330 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:18:22.330 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:18:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:18:24.872 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:24.872 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:18:25.373 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:18:27.017 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:27.980 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:27.980 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:18:28.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:28.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:28.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:28.557 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:28.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:28.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:28.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:28.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:28.710 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:28.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:28.763 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:18:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:18:31.215 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:18:31.216 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:18:31.311 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:18:31.541 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:18:33.808 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:18:34.021 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:18:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:18:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:18:34.021 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:18:34.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:34.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:34.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:34.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:34.239 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:34.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:34.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:34.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:34.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:34.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:34.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:34.434 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.439 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.439 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:18:34.635 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:18:37.255 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:18:37.446 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:18:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:18:38.224 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:18:40.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:40.269 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:40.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:40.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:40.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:40.390 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:40.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:40.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:40.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:40.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:40.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:40.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:18:40.834 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:18:41.053 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:18:41.054 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:18:41.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:18:41.054 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:18:41.054 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:18:41.758 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:18:43.099 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:18:44.143 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:18:44.310 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:18:44.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:18:44.310 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:18:44.310 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:18:45.492 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:18:45.891 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:45.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:45.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:45.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:45.988 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:46.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:46.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:46.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:46.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:46.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:46.204 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:46.236 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:18:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:18:47.225 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:18:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:18:48.538 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:18:49.009 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:18:50.170 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:18:51.430 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:18:52.187 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:18:52.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:52.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:52.521 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:52.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:52.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:52.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:52.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:52.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:52.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:52.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:52.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:52.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.861 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:18:52.996 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:18:55.090 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:18:55.090 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:18:55.090 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:18:55.091 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:18:55.701 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:18:55.755 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:18:56.333 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:18:58.496 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:18:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:18:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:18:58.497 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:18:58.497 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:18:58.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:18:58.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:18:58.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:18:58.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:18:58.690 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:18:58.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:18:58.741 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:18:58.767 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:18:58.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:18:58.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:18:58.846 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:18:58.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:18:58.874 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.875 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.876 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:18:58.975 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:18:59.085 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:19:01.468 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:19:01.965 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:19:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:19:02.719 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:19:04.127 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:04.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:04.175 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:04.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:04.226 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:04.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:04.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:04.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:04.331 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:04.359 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:04.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:04.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:19:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:19:05.510 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:19:05.512 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:19:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:19:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:19:05.512 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:19:06.046 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:19:07.072 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:19:09.023 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:19:09.023 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:19:09.023 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:19:09.024 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:19:09.024 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:19:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:19:09.731 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:19:09.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:09.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:09.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:09.876 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:09.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:09.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:09.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:09.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:10.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:10.034 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:10.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:10.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:19:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:19:12.097 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:19:12.143 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:19:12.698 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:19:12.761 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:19:15.364 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:19:15.586 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:16.390 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:16.390 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:19:16.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:16.818 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:16.840 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:16.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:16.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:16.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:16.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:16.971 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:17.027 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:17.053 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:17.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:17.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.083 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:19:17.084 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:19:18.131 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:19:18.746 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:19.438 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:19.438 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:19:19.887 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:19:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:19:22.001 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:22.811 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:22.812 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:19:23.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:23.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:23.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:23.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:23.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:23.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:23.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:23.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:23.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:23.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:23.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:23.540 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:23.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:19:23.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:19:24.299 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:19:24.985 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:25.801 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:25.802 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:19:26.416 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:19:27.170 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:19:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:29.266 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:29.266 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:19:29.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:29.396 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:29.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:29.456 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:29.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:29.504 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:29.585 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:29.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:29.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:29.665 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:19:29.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:19:30.032 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:19:31.768 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:32.372 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:32.372 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:19:32.401 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:19:33.168 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:19:35.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:35.247 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:35.283 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:35.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:35.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:35.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:35.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:35.440 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:35.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:35.506 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:35.527 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:35.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:35.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:19:35.868 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:19:36.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:36.216 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:19:38.366 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:19:38.701 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:39.204 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:19:39.485 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:39.486 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:19:41.169 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:41.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:41.219 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:41.258 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:41.285 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:41.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:41.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:41.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:41.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:41.420 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:41.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:41.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:41.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:19:41.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:19:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:42.273 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:19:42.512 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:42.512 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:19:44.123 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:19:44.889 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:19:45.531 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:45.532 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:19:46.930 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:46.954 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:46.979 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:47.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:47.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:47.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:47.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:47.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:47.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:47.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:47.212 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:47.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:19:47.215 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:19:48.125 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:19:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:49.069 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:49.070 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:19:49.758 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:19:51.330 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:19:52.129 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:52.799 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:52.799 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:19:53.184 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:53.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:53.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:53.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:53.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:53.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:53.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:53.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:53.478 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:53.511 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:53.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:53.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:53.568 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.569 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:19:53.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:19:54.160 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:19:55.294 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:56.198 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:56.199 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:19:56.289 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:19:56.908 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:19:59.043 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:19:59.315 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:19:59.340 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:19:59.364 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:19:59.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:19:59.414 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:19:59.439 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:19:59.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:19:59.491 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:19:59.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:19:59.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:19:59.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:19:59.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:19:59.599 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:19:59.759 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:19:59.759 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:20:00.068 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:20:02.149 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:20:02.286 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:02.887 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:02.887 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:20:03.185 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:20:05.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:20:05.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:20:05.415 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:20:05.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:20:05.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:20:05.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:20:05.543 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:20:05.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:20:05.600 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:05.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:20:05.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:20:05.672 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:20:05.699 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:20:05.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.703 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.703 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.703 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:20:05.703 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:20:06.215 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:20:06.427 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:06.427 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_blocked_ops 2019-12-23T00:20:08.596 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:20:08.971 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:09.220 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:20:09.672 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:09.672 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_historic_ops 2019-12-23T00:20:11.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:20:11.396 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:20:11.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:20:11.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:20:11.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:20:11.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:20:11.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:20:11.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:20:11.578 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:20:11.604 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:20:11.631 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:20:11.657 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:20:11.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:20:11.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:20:12.149 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:20:12.682 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:13.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:13.348 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_ops_in_flight 2019-12-23T00:20:14.165 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:20:15.337 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:20:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:16.693 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:16.693 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_blocked_ops 2019-12-23T00:20:17.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:20:17.399 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:20:17.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:20:17.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:20:17.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:20:17.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:20:17.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:20:17.581 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:20:17.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:20:17.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:20:17.656 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:20:17.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:20:17.684 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.684 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.684 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.684 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.684 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.685 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.685 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.685 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.685 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.685 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.685 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:20:17.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:20:18.194 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:20:19.009 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:19.727 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:19.727 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.11 dump_historic_ops 2019-12-23T00:20:20.523 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:20:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:20:22.833 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:23.493 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:23.493 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_ops_in_flight 2019-12-23T00:20:23.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:20:23.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:20:23.648 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:20:23.672 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:20:23.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:20:23.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:20:23.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:20:23.781 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:20:23.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:20:23.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:20:23.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:20:23.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:20:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:20:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:20:24.136 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:20:26.077 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:26.571 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:20:26.767 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:26.768 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_blocked_ops 2019-12-23T00:20:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:20:29.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:20:29.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:20:29.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:20:29.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:20:29.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:20:29.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:20:29.567 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:29.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:20:29.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:20:29.636 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:20:29.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:20:29.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:20:29.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:20:29.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:20:29.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:20:30.153 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:30.154 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.10 dump_historic_ops 2019-12-23T00:20:30.681 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:20:32.554 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:20:32.559 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:20:33.232 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:20:33.233 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_ops_in_flight 2019-12-23T00:20:34.201 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:20:35.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:20:35.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:20:35.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:20:35.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:20:35.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:20:35.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:20:36.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:20:36.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:20:36.056 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:20:36.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:20:36.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:20:36.130 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:20:36.134 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:20:36.135 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:20:36.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:20:37.033 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_blocked_ops 2019-12-23T00:20:37.115 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:20:38.880 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:20:39.671 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:20:40.440 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.1 dump_historic_ops 2019-12-23T00:20:41.242 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:20:42.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:20:42.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:20:42.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:20:42.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:20:42.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:20:42.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:20:42.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:20:42.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:20:42.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:20:42.250 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:20:42.252 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.252 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.252 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.252 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.253 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.253 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.253 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.253 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.253 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.253 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.254 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:20:42.254 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:20:43.196 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:20:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2019-12-23T00:20:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2019-12-23T00:20:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2019-12-23T00:20:43.197 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:20:43.810 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_ops_in_flight 2019-12-23T00:20:44.050 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:20:44.901 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:20:46.536 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:20:46.536 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:20:46.537 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:20:46.537 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:20:47.385 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_blocked_ops 2019-12-23T00:20:48.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:20:48.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:20:48.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:20:48.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:20:48.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:20:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:20:48.181 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:20:48.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:20:48.233 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:20:48.260 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:20:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:20:48.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:20:48.313 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:20:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:20:48.316 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:20:49.881 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:20:50.439 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.0 dump_historic_ops 2019-12-23T00:20:51.200 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:20:51.444 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:20:53.292 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:20:54.071 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_ops_in_flight 2019-12-23T00:20:54.824 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:20:54.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:20:54.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:20:54.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:20:54.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:20:54.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:20:54.978 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:20:55.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:20:55.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:20:55.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:20:55.088 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:20:55.115 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:20:55.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.121 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.122 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:20:55.353 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:20:56.775 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:20:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:20:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:20:56.776 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:20:57.325 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_blocked_ops 2019-12-23T00:20:58.060 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:20:58.371 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:21:00.517 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:21:00.517 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:21:00.517 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:21:00.517 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:21:00.517 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:21:01.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:01.188 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:01.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:01.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:01.189 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:01.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:01.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:01.301 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:01.324 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:01.338 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.3 dump_historic_ops 2019-12-23T00:21:01.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:01.396 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:01.397 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.398 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.398 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:21:01.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:21:03.725 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:21:04.034 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:21:04.318 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_ops_in_flight 2019-12-23T00:21:06.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:06.567 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:06.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:06.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:06.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:06.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:06.696 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:06.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:06.723 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:21:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:21:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2019-12-23T00:21:06.723 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:21:06.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:06.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:06.800 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:06.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.839 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:21:06.839 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:21:07.489 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_blocked_ops 2019-12-23T00:21:09.615 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2019-12-23T00:21:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2019-12-23T00:21:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2019-12-23T00:21:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2019-12-23T00:21:09.615 INFO:teuthology.orchestra.run.smithi071.stdout:} 2019-12-23T00:21:09.663 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:21:10.309 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.2 dump_historic_ops 2019-12-23T00:21:12.352 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:21:12.559 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:12.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:12.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:12.664 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:12.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:12.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:12.745 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:12.791 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:12.801 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:12.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:12.855 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:12.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:12.885 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.885 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.886 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.886 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.886 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.886 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.886 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:21:12.962 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2019-12-23T00:21:13.757 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_ops_in_flight 2019-12-23T00:21:15.089 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:21:15.559 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:21:15.889 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:16.734 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:16.734 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_blocked_ops 2019-12-23T00:21:18.888 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:21:18.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:19.010 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:19.035 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:19.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:19.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:19.110 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:19.138 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:19.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:19.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:19.218 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:19.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:19.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:19.272 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:21:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:21:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:20.654 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:20.655 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.5 dump_historic_ops 2019-12-23T00:21:21.545 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:21:22.103 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:21:23.061 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:24.182 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:24.183 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_ops_in_flight 2019-12-23T00:21:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:21:25.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:25.850 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:25.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:25.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:25.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:25.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:26.001 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:26.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:26.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:26.111 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:26.145 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:26.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:21:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:21:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:27.698 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:27.698 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_blocked_ops 2019-12-23T00:21:28.167 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set nodeep-scrub 2019-12-23T00:21:28.856 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:21:30.611 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:31.448 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:31.448 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.4 dump_historic_ops 2019-12-23T00:21:31.872 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:31.893 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:31.916 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:31.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:31.965 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:32.011 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:32.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:32.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:32.108 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:32.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:32.162 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:32.201 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:32.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.201 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.203 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:21:32.352 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2019-12-23T00:21:34.012 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:34.636 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:34.637 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_ops_in_flight 2019-12-23T00:21:35.175 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:21:35.409 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset noscrub 2019-12-23T00:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:38.020 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:38.020 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_blocked_ops 2019-12-23T00:21:38.742 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:38.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:38.797 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:38.822 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:38.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:38.877 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:38.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:38.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:38.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:38.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:39.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:39.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:39.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.051 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.051 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.051 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.051 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.052 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.052 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.052 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.052 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.053 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:21:39.889 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2019-12-23T00:21:40.961 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:41.592 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:41.593 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.7 dump_historic_ops 2019-12-23T00:21:42.048 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:21:42.581 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd unset nodeep-scrub 2019-12-23T00:21:44.393 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:44.853 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:44.881 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:44.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:44.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:44.956 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:44.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:45.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:45.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:45.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:45.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:45.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:45.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:45.174 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:21:45.305 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:45.306 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_ops_in_flight 2019-12-23T00:21:47.247 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2019-12-23T00:21:47.865 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:48.087 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:21:48.360 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:48.361 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_blocked_ops 2019-12-23T00:21:49.934 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph osd set noscrub 2019-12-23T00:21:50.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:50.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:50.625 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:50.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:50.677 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:50.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:50.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:50.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:50.806 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:50.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:50.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:50.866 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:50.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:50.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.896 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.897 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:21:50.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:21:51.514 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:51.515 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.6 dump_historic_ops 2019-12-23T00:21:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:54.112 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2019-12-23T00:21:54.716 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:54.716 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_ops_in_flight 2019-12-23T00:21:56.898 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:21:56.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:21:56.945 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:21:56.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:21:56.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:21:57.021 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:21:57.047 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:21:57.073 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:21:57.100 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:21:57.118 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:21:57.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:21:57.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:21:57.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:21:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'true' 2019-12-23T00:21:57.884 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:21:57.885 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_blocked_ops 2019-12-23T00:22:00.024 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:22:00.051 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2019-12-23T00:22:00.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:22:00.680 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.9 dump_historic_ops 2019-12-23T00:22:02.798 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2019-12-23T00:22:02.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2019-12-23T00:22:02.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2019-12-23T00:22:02.894 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2019-12-23T00:22:02.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2019-12-23T00:22:02.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2019-12-23T00:22:02.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2019-12-23T00:22:03.007 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2019-12-23T00:22:03.026 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2019-12-23T00:22:03.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.8: {} 2019-12-23T00:22:03.060 INFO:teuthology.orchestra.run.smithi071.stdout:osd.9: {} 2019-12-23T00:22:03.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.10: {} 2019-12-23T00:22:03.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.11: {} 2019-12-23T00:22:03.124 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.124 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.124 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.124 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.8: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.9: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.125 INFO:teuthology.orchestra.run.smithi071.stderr:osd.10: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.11: osd_enable_op_tracker = 'false' 2019-12-23T00:22:03.761 DEBUG:teuthology.orchestra.run:got remote process result: 22 2019-12-23T00:22:03.762 INFO:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:99b509ffd4dd354919b08b38ba83b998fbfdc107 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 7a4dd340-2509-11ea-8284-001a4aab830c -- ceph daemon osd.8 dump_ops_in_flight 2019-12-23T00:22:04.239 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2019-12-23T00:22:05.352 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-23T00:22:05.353 DEBUG:teuthology.task.console_log:Killing console logger for smithi168 2019-12-23T00:22:05.353 DEBUG:teuthology.task.console_log:Killing console logger for smithi187 2019-12-23T00:22:05.353 DEBUG:teuthology.task.console_log:Killing console logger for smithi071 2019-12-23T00:22:05.354 DEBUG:teuthology.task.console_log:Killing console logger for smithi168 2019-12-23T00:22:05.354 DEBUG:teuthology.task.console_log:Killing console logger for smithi187 2019-12-23T00:22:05.354 DEBUG:teuthology.task.console_log:Killing console logger for smithi071 2019-12-23T00:22:05.354 DEBUG:teuthology.exit:Finished running handlers