2020-08-31T22:00:00.301 INFO:root:teuthology version: 1.0.0-ec650ed 2020-08-31T22:00:00.304 DEBUG:teuthology.run:Teuthology command: teuthology --description kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} --archive /home/teuthworker/archive/pdonnell-2020-08-31_21:26:19-kcephfs-wip-pdonnell-testing-20200829.172552-distro-basic-smithi/5396232 --name pdonnell-2020-08-31_21:26:19-kcephfs-wip-pdonnell-testing-20200829.172552-distro-basic-smithi --owner scheduled_pdonnell@teuthology --verbose --lock --block -- /tmp/teuthology-worker.lbwtjsdn.tmp 2020-08-31T22:00:00.341 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-08-31T22:00:00.402 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-08-31_21:26:19-kcephfs-wip-pdonnell-testing-20200829.172552-distro-basic-smithi/5396232 branch: wip-pdonnell-testing-20200829.172552 description: kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} email: pdonnell@redhat.com first_in_suite: false job_id: '5396232' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-08-31_21:26:19-kcephfs-wip-pdonnell-testing-20200829.172552-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-pdonnell-testing-20200829.172552 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: c5af0d54b89ffb9f4c441f7a4e930a89dee8fecf ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: c5af0d54b89ffb9f4c441f7a4e930a89dee8fecf selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20200829.172552 sha1: c5af0d54b89ffb9f4c441f7a4e930a89dee8fecf owner: scheduled_pdonnell@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 sha1: c5af0d54b89ffb9f4c441f7a4e930a89dee8fecf sleep_before_teardown: 0 suite: kcephfs suite_branch: wip-pdonnell-testing-20200829.172552 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200829.172552/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: c5af0d54b89ffb9f4c441f7a4e930a89dee8fecf tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - exec: client.0: - sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - kclient: null - workunit: clients: all: - suites/iozone.sh teuthology_branch: refs/pull/1554/merge timestamp: 2020-08-31_21:26:19 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.21831 2020-08-31T22:00:00.402 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200829.172552/qa; will attempt to use it 2020-08-31T22:00:00.403 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200829.172552/qa/tasks 2020-08-31T22:00:00.404 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-08-31T22:00:00.406 INFO:teuthology.task.internal:Checking packages... 2020-08-31T22:00:00.429 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'c5af0d54b89ffb9f4c441f7a4e930a89dee8fecf' 2020-08-31T22:00:00.429 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-08-31T22:00:00.430 INFO:teuthology.packaging:ref: None 2020-08-31T22:00:00.430 INFO:teuthology.packaging:tag: None 2020-08-31T22:00:00.431 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20200829.172552 2020-08-31T22:00:00.431 INFO:teuthology.packaging:sha1: c5af0d54b89ffb9f4c441f7a4e930a89dee8fecf 2020-08-31T22:00:00.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200829.172552 2020-08-31T22:00:00.595 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-4885.gc5af0d5 2020-08-31T22:00:00.596 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-08-31T22:00:00.603 INFO:teuthology.task.internal:no buildpackages task found 2020-08-31T22:00:00.604 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-08-31T22:00:00.617 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-08-31T22:00:00.618 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-08-31T22:00:00.667 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:00:10.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:00:20.703 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:00:30.724 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:00:40.740 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:00:50.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:01:00.780 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:01:10.803 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:01:20.826 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:01:30.846 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:01:40.867 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:01:50.890 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:02:00.912 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:02:10.931 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:02:20.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:02:30.971 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:02:40.988 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:02:51.009 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:03:01.030 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:03:11.050 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:03:21.081 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:03:31.107 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:03:41.125 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:03:51.146 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:04:01.165 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:04:11.187 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:04:21.203 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:04:31.243 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:04:41.258 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:04:51.281 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:05:01.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:05:11.320 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:05:21.337 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:05:31.358 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:05:41.378 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:05:51.396 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:06:01.416 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:06:11.443 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:06:21.470 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:06:31.489 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:06:41.507 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:06:51.526 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:07:01.545 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:07:11.566 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:07:21.585 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:07:31.603 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:07:41.619 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:07:51.639 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:08:01.658 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:08:11.676 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:08:21.696 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:08:31.717 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:08:41.738 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:08:51.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:09:01.782 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:09:11.801 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:09:21.821 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:09:31.837 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:09:41.859 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:09:51.875 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:10:01.899 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-08-31T22:10:11.924 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:10:21.944 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:10:31.965 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-08-31T22:10:41.988 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:10:52.007 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-08-31T22:11:02.026 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 3, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-08-31_21:26:19-kcephfs-wip-pdonnell-testing-20200829.172552-distro-basic-smithi/5396232'} 2020-08-31T22:11:02.052 DEBUG:teuthology.lock.ops:locked ubuntu@smithi105.front.sepia.ceph.com, ubuntu@smithi198.front.sepia.ceph.com, ubuntu@smithi031.front.sepia.ceph.com 2020-08-31T22:11:02.189 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f47bad9fd90>, signals=[15]) 2020-08-31T22:11:02.414 INFO:teuthology.provision.fog.smithi198:Scheduling deploy of centos 8.1 2020-08-31T22:11:02.430 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 8.1 2020-08-31T22:11:02.453 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.1 2020-08-31T22:11:02.893 INFO:teuthology.orchestra.console:Power off smithi105 2020-08-31T22:11:02.894 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-08-31T22:11:02.930 INFO:teuthology.orchestra.console:Power off smithi198 2020-08-31T22:11:02.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-08-31T22:11:02.957 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:02.984 INFO:teuthology.orchestra.console:Power off smithi031 2020-08-31T22:11:02.986 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-08-31T22:11:02.999 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:03.013 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:03.129 INFO:teuthology.orchestra.console:Power off for smithi198 completed 2020-08-31T22:11:03.142 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2020-08-31T22:11:03.230 INFO:teuthology.orchestra.console:Power on smithi198 2020-08-31T22:11:03.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-08-31T22:11:03.252 INFO:teuthology.orchestra.console:Power on smithi031 2020-08-31T22:11:03.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-08-31T22:11:03.266 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:03.282 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:07.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:07.297 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:07.311 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:07.525 INFO:teuthology.orchestra.console:Power on for smithi031 completed 2020-08-31T22:11:07.627 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2020-08-31T22:11:11.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:11.345 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2020-08-31T22:11:11.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:11.448 INFO:teuthology.orchestra.console:Power on smithi105 2020-08-31T22:11:11.449 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-08-31T22:11:11.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:11.631 INFO:teuthology.orchestra.console:Power on for smithi198 completed 2020-08-31T22:11:11.733 INFO:teuthology.provision.fog.smithi198:Waiting for deploy to finish 2020-08-31T22:11:15.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:19.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-08-31T22:11:19.842 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2020-08-31T22:11:19.944 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2020-08-31T22:13:24.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:13:33.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:13:42.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:13:43.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:13:51.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:13:51.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:13:52.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:00.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:00.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:01.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:09.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:09.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:10.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:18.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:19.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:28.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:28.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:37.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:37.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:14:46.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:15.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:15.769 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-08-31T22:15:15.773 INFO:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-08-31T22:15:16.133 INFO:teuthology.provision.fog.smithi031:Node is ready 2020-08-31T22:15:16.134 INFO:teuthology.orchestra.run.smithi031:> hostname 2020-08-31T22:15:16.148 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2020-08-31T22:15:16.149 INFO:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2020-08-31T22:15:16.204 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2020-08-31T22:15:16.205 INFO:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2020-08-31T22:15:16.332 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2020-08-31T22:15:16.365 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2020-08-31T22:15:16.437 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2020-08-31T22:15:16.509 INFO:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2020-08-31T22:15:16.580 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2020-08-31T22:15:16.581 DEBUG:teuthology.parallel:result is None 2020-08-31T22:15:43.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:44.064 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-08-31T22:15:44.065 INFO:teuthology.orchestra.run.smithi198:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-08-31T22:15:44.395 INFO:teuthology.provision.fog.smithi198:Node is ready 2020-08-31T22:15:44.395 INFO:teuthology.orchestra.run.smithi198:> hostname 2020-08-31T22:15:44.410 INFO:teuthology.orchestra.run.smithi198.stdout:smithi198.front.sepia.ceph.com 2020-08-31T22:15:44.410 INFO:teuthology.orchestra.run.smithi198:> grep smithi198.front.sepia.ceph.com /etc/hosts 2020-08-31T22:15:44.464 INFO:teuthology.orchestra.run.smithi198.stdout:172.21.15.198 smithi198.front.sepia.ceph.com smithi198 2020-08-31T22:15:44.464 INFO:teuthology.orchestra.run.smithi198:> sudo hostname smithi198 2020-08-31T22:15:44.571 INFO:teuthology.orchestra.run.smithi198:> sudo sed -i -e 's/smithi198.front.sepia.ceph.com/smithi198/g' /etc/hosts 2020-08-31T22:15:44.600 INFO:teuthology.orchestra.run.smithi198:> sudo sed -i -e 's/172.21.15.198/172.21.15.198/g' /etc/hosts 2020-08-31T22:15:44.669 INFO:teuthology.orchestra.run.smithi198:> sudo sed -i -e 's/smithi198.front.sepia.ceph.com/smithi198/g' /etc/hostname 2020-08-31T22:15:44.735 INFO:teuthology.orchestra.run.smithi198:> sudo hostname smithi198 2020-08-31T22:15:44.801 INFO:teuthology.provision.fog.smithi198:Deploy complete! 2020-08-31T22:15:44.803 DEBUG:teuthology.parallel:result is None 2020-08-31T22:15:52.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:52.489 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-08-31T22:15:52.489 INFO:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-08-31T22:15:52.819 INFO:teuthology.provision.fog.smithi105:Node is ready 2020-08-31T22:15:52.819 INFO:teuthology.orchestra.run.smithi105:> hostname 2020-08-31T22:15:52.838 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2020-08-31T22:15:52.839 INFO:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2020-08-31T22:15:52.893 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2020-08-31T22:15:52.894 INFO:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2020-08-31T22:15:53.008 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2020-08-31T22:15:53.037 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2020-08-31T22:15:53.105 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2020-08-31T22:15:53.171 INFO:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2020-08-31T22:15:53.238 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2020-08-31T22:15:53.239 DEBUG:teuthology.parallel:result is None 2020-08-31T22:15:53.430 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2020-08-31T22:15:53.431 INFO:teuthology.lock.ops:New key found. Updating... 2020-08-31T22:15:53.449 INFO:teuthology.lock.ops:Checking smithi198.front.sepia.ceph.com 2020-08-31T22:15:53.450 INFO:teuthology.lock.ops:New key found. Updating... 2020-08-31T22:15:53.464 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2020-08-31T22:15:53.465 INFO:teuthology.lock.ops:New key found. Updating... 2020-08-31T22:15:53.481 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2020-08-31T22:15:53.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-08-31T22:15:53.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:53.552 INFO:teuthology.orchestra.run.smithi105:> true 2020-08-31T22:15:53.709 INFO:teuthology.orchestra.run.smithi105:> uname -m 2020-08-31T22:15:53.762 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2020-08-31T22:15:53.764 INFO:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2020-08-31T22:15:53.816 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Linux" 2020-08-31T22:15:53.818 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8 (Core)" 2020-08-31T22:15:53.818 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2020-08-31T22:15:53.819 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2020-08-31T22:15:53.819 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2020-08-31T22:15:53.819 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2020-08-31T22:15:53.819 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-08-31T22:15:53.819 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2020-08-31T22:15:53.820 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-08-31T22:15:53.820 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.centos.org/" 2020-08-31T22:15:53.820 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-08-31T22:15:53.820 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-31T22:15:53.820 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-08-31T22:15:53.821 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-08-31T22:15:53.821 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-08-31T22:15:53.821 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-08-31T22:15:53.821 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-31T22:15:53.823 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2020-08-31T22:15:53.841 INFO:teuthology.lock.ops:Updating [smithi198.front.sepia.ceph.com]: set os type and version on server 2020-08-31T22:15:53.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-08-31T22:15:53.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:53.914 INFO:teuthology.orchestra.run.smithi198:> true 2020-08-31T22:15:54.080 INFO:teuthology.orchestra.run.smithi198:> uname -m 2020-08-31T22:15:54.134 INFO:teuthology.orchestra.run.smithi198.stdout:x86_64 2020-08-31T22:15:54.134 INFO:teuthology.orchestra.run.smithi198:> cat /etc/os-release 2020-08-31T22:15:54.189 INFO:teuthology.orchestra.run.smithi198.stdout:NAME="CentOS Linux" 2020-08-31T22:15:54.189 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION="8 (Core)" 2020-08-31T22:15:54.190 INFO:teuthology.orchestra.run.smithi198.stdout:ID="centos" 2020-08-31T22:15:54.190 INFO:teuthology.orchestra.run.smithi198.stdout:ID_LIKE="rhel fedora" 2020-08-31T22:15:54.190 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_ID="8" 2020-08-31T22:15:54.190 INFO:teuthology.orchestra.run.smithi198.stdout:PLATFORM_ID="platform:el8" 2020-08-31T22:15:54.190 INFO:teuthology.orchestra.run.smithi198.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-08-31T22:15:54.191 INFO:teuthology.orchestra.run.smithi198.stdout:ANSI_COLOR="0;31" 2020-08-31T22:15:54.191 INFO:teuthology.orchestra.run.smithi198.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-08-31T22:15:54.191 INFO:teuthology.orchestra.run.smithi198.stdout:HOME_URL="https://www.centos.org/" 2020-08-31T22:15:54.191 INFO:teuthology.orchestra.run.smithi198.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-08-31T22:15:54.191 INFO:teuthology.orchestra.run.smithi198.stdout: 2020-08-31T22:15:54.192 INFO:teuthology.orchestra.run.smithi198.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-08-31T22:15:54.192 INFO:teuthology.orchestra.run.smithi198.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-08-31T22:15:54.192 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-08-31T22:15:54.192 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-08-31T22:15:54.192 INFO:teuthology.orchestra.run.smithi198.stdout: 2020-08-31T22:15:54.193 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server 2020-08-31T22:15:54.208 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2020-08-31T22:15:54.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-08-31T22:15:54.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:54.280 INFO:teuthology.orchestra.run.smithi031:> true 2020-08-31T22:15:54.376 INFO:teuthology.orchestra.run.smithi031:> uname -m 2020-08-31T22:15:54.433 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2020-08-31T22:15:54.434 INFO:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2020-08-31T22:15:54.490 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Linux" 2020-08-31T22:15:54.490 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8 (Core)" 2020-08-31T22:15:54.491 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2020-08-31T22:15:54.491 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2020-08-31T22:15:54.491 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2020-08-31T22:15:54.491 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2020-08-31T22:15:54.491 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-08-31T22:15:54.492 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2020-08-31T22:15:54.492 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-08-31T22:15:54.492 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.centos.org/" 2020-08-31T22:15:54.492 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-08-31T22:15:54.492 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-08-31T22:15:54.493 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-08-31T22:15:54.493 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-08-31T22:15:54.493 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-08-31T22:15:54.493 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-08-31T22:15:54.493 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-08-31T22:15:54.494 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2020-08-31T22:15:54.510 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-08-31T22:15:54.572 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpWcR9N/iznK4iGvIdHQict1iZDYhN6DbgfJTtABCcg5s/r0n+ZSKo5R8nagzdF7bs9P2mpuHTXBUf9KAvUDKqhaXxXOqtAld3sDTVwEObRXqOPCEPzftZsQSuYfV8k64NAUq+aEB/9+K3x22q9il7cb/IiC1B+EvGldzGCUKzr8whfeHxwQdDxsGlyfmBFlAuizdVwpqORFisGeiWbC59A8o4PKNnbk7FZoA09VvSAVzQqnvGdTvXZ0SeIHby8dyAgm5+iTHDGWVN4lrz6AbD2iU4XA7Uo46xaq/QRz3f1zFwa6Dv/Zp0oExO3bys+kc0arIwuboNvWMGWfZk30Unilx7NEsjZ/XyczEspgJirCi/68ZX4vXv6S9Gzl/XeuSC5iQQ2eO3/sY36e1TQnGLXbr83hLlYomIlVfP91RECHD91MQsly4L/acGcYJvhXskHfdcFrHOvs273mbIcbL9IQkC7lKfCd9CNXy74hI0cmUPttPzDeAuXX1tQhq7rB8= smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+1xyXOrbcxDlKwla05lzeQi9FaAmEWBhpU+lC4iroMheONc9IxawwB5hF8Dffdyx6rIjHUX57BeA+ctUBR+2MV1A6XMyua4R00WcBWjE+cT533uZEJunuU9AuYvv7ShLG3NDLNE5J1iW9hAjOvwy69JbsX/Va7993EyCIRP37SQHOjJr6dXesRDpU+JnIQ+KbQ8U8yxd+Z1oALcQu6F9Y6JxsqK55ydSaxQL0fHXz0m+9DZ2nSAYNai9HS6omsEGsryeK4nA8WgaTaOUikWduF0mq/61n1idfK+yAIUmOa2SJ1o3uxjrmPICJg83Dcaxc3pOfUzwWM7d8j25sEaESiQERlt71Wl7uWF4EGzIcF2jvtSnmBDtd/KxsUbg38ZzR4mxefbHvIqztvRJRCSRrK9M22jvlNLcxlOmtuIc6XcnlYDFSbrxjo2Jpg7gIcmtADMvuOzxSMk/NQ0A4o1saDX/In5Uv0MQzpLg0Xck6ZSFK2VeZZ64aYymuyCesYmM= smithi198.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1zcOEyUXVyGOA7ji6PsQcs+sxKs4wq8K0fsJ5+nsBGZ9/Eqk2Ny4bdZh9VWfPUt4Hp9FYh38ahvrbh2cX5degXSb6Lj/PMMT/TB5a6a/b0IWVb3T8KwlPUew2OiQ4sOAtMm6tQLHWV7OeoHtR/LlIRck965tuWufnyuTgtKmbvV2TUOhNsIY9rlsF9pd0f7rfoYbOFp+fnb5NNaCnxfJdDpSg2jbBBdvihS6XLhzn1Qvk1ebv/xmKjJidDPR7hAqqibt60J3tU6egHB3SMyP7JHCy31Uk9yMp88+KNL/Vaah5eIoUIMyO3A24voPSgpvnHVHqB5l/N7B5EXYjI2OAGRbaofmP7N3CVmw8L6rS1YV+wzH7whABx8TDAe5dVoBva2RgzvqgyMBj4uFOJnVFw0ufRgyXRiadN1A5xKE0A1bpz+NwencyM6MjlbfWClCkguPzuoYs0ofW41f+fX2Tn4ycCUhiipGVb2b/df8bdpk9i0wRQ1oEhV5yTbTQRic= 2020-08-31T22:15:54.573 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-08-31T22:15:54.631 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-08-31T22:15:54.642 INFO:teuthology.task.internal:Saving configuration 2020-08-31T22:15:54.661 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-08-31T22:15:54.720 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-08-31T22:15:54.744 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-08-31 22:11:02.034898', 'description': '/home/teuthworker/archive/pdonnell-2020-08-31_21:26:19-kcephfs-wip-pdonnell-testing-20200829.172552-distro-basic-smithi/5396232', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmrXL7J+hUCYajR+pGLsK6pSC6n0BD41cekul580RaGiXMGKOrv/YcV6KvygJcdn9OY+xQ5XLmxrsF3UchOIUs=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi105.front.sepia.ceph.com'} 2020-08-31T22:15:54.760 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-08-31 22:11:02.034919', 'description': '/home/teuthworker/archive/pdonnell-2020-08-31_21:26:19-kcephfs-wip-pdonnell-testing-20200829.172552-distro-basic-smithi/5396232', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPzZyT7IbpoFtlTJU9tWUuGCjgdc0UVfDLn6E8nuxVC7gZDmC1WRJ+Vr+eR0bNq3J6Gx5f8xsA0A96JDCeFyWqc=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi198.front.sepia.ceph.com'} 2020-08-31T22:15:54.777 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-08-31 22:11:02.034935', 'description': '/home/teuthworker/archive/pdonnell-2020-08-31_21:26:19-kcephfs-wip-pdonnell-testing-20200829.172552-distro-basic-smithi/5396232', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJackAnE6brOyyQnTd7nyzTDWGbXMocC+uLnRT0dYTBg4xReL1i/zKcGxcQvdizvfq7Bf9LwShvNFlro4Du770Q=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi031.front.sepia.ceph.com'} 2020-08-31T22:15:54.778 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-08-31T22:15:54.789 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2020-08-31T22:15:54.790 INFO:teuthology.task.internal:roles: ubuntu@smithi198.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-08-31T22:15:54.790 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['client.0'] 2020-08-31T22:15:54.790 INFO:teuthology.run_tasks:Running task console_log... 2020-08-31T22:15:54.946 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f47be824620>, signals=[15]) 2020-08-31T22:15:54.947 INFO:teuthology.run_tasks:Running task internal.connect... 2020-08-31T22:15:54.962 INFO:teuthology.task.internal:Opening connections... 2020-08-31T22:15:54.963 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2020-08-31T22:15:54.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:55.084 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi198.front.sepia.ceph.com 2020-08-31T22:15:55.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:55.159 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2020-08-31T22:15:55.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-08-31T22:15:55.235 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-08-31T22:15:55.247 INFO:teuthology.orchestra.run.smithi105:> uname -m 2020-08-31T22:15:55.267 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2020-08-31T22:15:55.267 INFO:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2020-08-31T22:15:55.320 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Linux" 2020-08-31T22:15:55.321 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8 (Core)" 2020-08-31T22:15:55.321 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2020-08-31T22:15:55.321 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2020-08-31T22:15:55.321 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2020-08-31T22:15:55.322 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2020-08-31T22:15:55.322 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-08-31T22:15:55.322 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2020-08-31T22:15:55.322 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-08-31T22:15:55.322 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.centos.org/" 2020-08-31T22:15:55.332 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-08-31T22:15:55.332 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-31T22:15:55.332 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-08-31T22:15:55.332 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-08-31T22:15:55.332 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-08-31T22:15:55.333 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-08-31T22:15:55.333 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-08-31T22:15:55.333 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2020-08-31T22:15:55.452 INFO:teuthology.orchestra.run.smithi198:> uname -m 2020-08-31T22:15:55.467 INFO:teuthology.orchestra.run.smithi198.stdout:x86_64 2020-08-31T22:15:55.468 INFO:teuthology.orchestra.run.smithi198:> cat /etc/os-release 2020-08-31T22:15:55.521 INFO:teuthology.orchestra.run.smithi198.stdout:NAME="CentOS Linux" 2020-08-31T22:15:55.521 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION="8 (Core)" 2020-08-31T22:15:55.522 INFO:teuthology.orchestra.run.smithi198.stdout:ID="centos" 2020-08-31T22:15:55.522 INFO:teuthology.orchestra.run.smithi198.stdout:ID_LIKE="rhel fedora" 2020-08-31T22:15:55.522 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_ID="8" 2020-08-31T22:15:55.522 INFO:teuthology.orchestra.run.smithi198.stdout:PLATFORM_ID="platform:el8" 2020-08-31T22:15:55.522 INFO:teuthology.orchestra.run.smithi198.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-08-31T22:15:55.523 INFO:teuthology.orchestra.run.smithi198.stdout:ANSI_COLOR="0;31" 2020-08-31T22:15:55.523 INFO:teuthology.orchestra.run.smithi198.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-08-31T22:15:55.523 INFO:teuthology.orchestra.run.smithi198.stdout:HOME_URL="https://www.centos.org/" 2020-08-31T22:15:55.523 INFO:teuthology.orchestra.run.smithi198.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-08-31T22:15:55.523 INFO:teuthology.orchestra.run.smithi198.stdout: 2020-08-31T22:15:55.524 INFO:teuthology.orchestra.run.smithi198.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-08-31T22:15:55.524 INFO:teuthology.orchestra.run.smithi198.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-08-31T22:15:55.524 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-08-31T22:15:55.524 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-08-31T22:15:55.524 INFO:teuthology.orchestra.run.smithi198.stdout: 2020-08-31T22:15:55.525 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server 2020-08-31T22:15:55.545 INFO:teuthology.orchestra.run.smithi031:> uname -m 2020-08-31T22:15:55.565 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2020-08-31T22:15:55.566 INFO:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2020-08-31T22:15:55.626 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Linux" 2020-08-31T22:15:55.626 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8 (Core)" 2020-08-31T22:15:55.627 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2020-08-31T22:15:55.627 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2020-08-31T22:15:55.627 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2020-08-31T22:15:55.627 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2020-08-31T22:15:55.628 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-08-31T22:15:55.628 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2020-08-31T22:15:55.628 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-08-31T22:15:55.628 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.centos.org/" 2020-08-31T22:15:55.628 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-08-31T22:15:55.629 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-08-31T22:15:55.629 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-08-31T22:15:55.629 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-08-31T22:15:55.629 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-08-31T22:15:55.629 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-08-31T22:15:55.629 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-08-31T22:15:55.630 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2020-08-31T22:15:55.648 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-08-31T22:15:55.663 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-08-31T22:15:55.674 INFO:teuthology.task.internal:Checking for old test directory... 2020-08-31T22:15:55.674 INFO:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2020-08-31T22:15:55.677 INFO:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2020-08-31T22:15:55.680 INFO:teuthology.orchestra.run.smithi198:> test '!' -e /home/ubuntu/cephtest 2020-08-31T22:15:55.694 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-08-31T22:15:55.704 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-08-31T22:15:55.705 INFO:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2020-08-31T22:15:55.735 INFO:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2020-08-31T22:15:55.737 INFO:teuthology.orchestra.run.smithi198:> test -z $(ls -A /var/lib/ceph) 2020-08-31T22:15:55.766 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-08-31T22:15:55.865 INFO:teuthology.run_tasks:Running task kernel... 2020-08-31T22:15:55.886 DEBUG:teuthology.task.kernel:normalized config {'client.0': {'branch': 'testing'}} 2020-08-31T22:15:55.887 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2020-08-31T22:15:55.887 INFO:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2020-08-31T22:15:55.958 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS 2020-08-31T22:15:55.960 DEBUG:teuthology.misc:System to be installed: CentOS 2020-08-31T22:15:55.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2020-08-31T22:15:56.209 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7b4196f8b36937040ee59cf376f44604f885ef7e 2020-08-31T22:15:56.221 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7b4196f8b36937040ee59cf376f44604f885ef7e"... 2020-08-31T22:15:56.221 INFO:teuthology.orchestra.run.smithi031:> uname -r 2020-08-31T22:15:56.239 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-193.14.2.el8_2.x86_64 2020-08-31T22:15:56.240 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-193.14.2.el8_2.x86_64 vs 7b4196f8b36937040ee59cf376f44604f885ef7e 2020-08-31T22:15:56.241 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2020-08-31T22:15:56.242 INFO:teuthology.orchestra.run.smithi031:> sudo yum upgrade -y linux-firmware 2020-08-31T22:15:58.837 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - AppStream 34 MB/s | 7.0 MB 00:00 2020-08-31T22:16:00.138 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-08-31T22:16:00.619 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Extras 75 kB/s | 5.5 kB 00:00 2020-08-31T22:16:01.079 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 19 MB/s | 7.9 MB 00:00 2020-08-31T22:16:02.894 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-08-31T22:16:04.095 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-08-31T22:16:04.096 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-08-31T22:16:04.096 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-08-31T22:16:04.242 INFO:teuthology.task.kernel:Downloading kernel 7b4196f8b36937040ee59cf376f44604f885ef7e on client.0... 2020-08-31T22:16:04.242 INFO:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2020-08-31T22:16:04.282 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS 2020-08-31T22:16:04.283 DEBUG:teuthology.misc:System to be installed: CentOS 2020-08-31T22:16:04.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b4196f8b36937040ee59cf376f44604f885ef7e 2020-08-31T22:16:04.460 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/7b4196f8b36937040ee59cf376f44604f885ef7e/centos/8/flavors/default/x86_64/ 2020-08-31T22:16:04.461 INFO:teuthology.orchestra.run.smithi031:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.9.0_rc2_ceph_g7b4196f8b369-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/7b4196f8b36937040ee59cf376f44604f885ef7e/centos/8/flavors/default/x86_64/ --input-file=- 2020-08-31T22:16:04.464 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi031.front.sepia.ceph.com to complete... 2020-08-31T22:16:38.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-08-31 22:16:38 URL:https://4.chacra.ceph.com/r/kernel/testing/7b4196f8b36937040ee59cf376f44604f885ef7e/centos/8/flavors/default/x86_64/kernel-5.9.0_rc2_ceph_g7b4196f8b369-1.x86_64.rpm [467932924/467932924] -> "/tmp/kernel.x86_64.rpm" [1] 2020-08-31T22:16:38.029 INFO:teuthology.orchestra.run.smithi031.stderr:FINISHED --2020-08-31 22:16:38-- 2020-08-31T22:16:38.029 INFO:teuthology.orchestra.run.smithi031.stderr:Total wall clock time: 34s 2020-08-31T22:16:38.030 INFO:teuthology.orchestra.run.smithi031.stderr:Downloaded: 1 files, 446M in 33s (13.5 MB/s) 2020-08-31T22:16:38.031 INFO:teuthology.task.kernel:Installing kernel 7b4196f8b36937040ee59cf376f44604f885ef7e on client.0... 2020-08-31T22:16:38.033 INFO:teuthology.orchestra.run.smithi031:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2020-08-31T22:16:40.049 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying... ######################################## 2020-08-31T22:16:43.054 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing... ######################################## 2020-08-31T22:16:43.129 INFO:teuthology.orchestra.run.smithi031.stdout:Updating / installing... 2020-08-31T22:17:19.957 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-5.9.0_rc2_ceph_g7b4196f8b369-1 ######################################## 2020-08-31T22:17:25.793 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-08-31T22:17:25.796 DEBUG:teuthology.task.console_log:Killing console logger for smithi105 2020-08-31T22:17:25.797 DEBUG:teuthology.task.console_log:Killing console logger for smithi198 2020-08-31T22:17:25.797 DEBUG:teuthology.task.console_log:Killing console logger for smithi031 2020-08-31T22:17:25.798 DEBUG:teuthology.task.console_log:Killing console logger for smithi105 2020-08-31T22:17:25.798 DEBUG:teuthology.task.console_log:Killing console logger for smithi198 2020-08-31T22:17:25.798 DEBUG:teuthology.task.console_log:Killing console logger for smithi031 2020-08-31T22:17:25.799 DEBUG:teuthology.exit:Finished running handlers