2020-02-14T15:27:03.576 INFO:root:teuthology version: 1.0.0-ee19bca 2020-02-14T15:27:03.576 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.t_u_rx.tmp -- --verbose --lock --description rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_8.yaml} tasks/dashboard.yaml} --name kchai-2020-02-14_15:08:49-rados-wip-kefu-testing-2020-02-14-2045-distro-basic-smithi --block --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2020-02-14_15:08:49-rados-wip-kefu-testing-2020-02-14-2045-distro-basic-smithi/4763795 2020-02-14T15:27:03.614 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-14T15:27:03.678 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-02-14_15:08:49-rados-wip-kefu-testing-2020-02-14-2045-distro-basic-smithi/4763795 branch: wip-kefu-testing-2020-02-14-2045 description: rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_8.yaml} tasks/dashboard.yaml} email: null first_in_suite: false job_id: '4763795' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: kchai-2020-02-14_15:08:49-rados-wip-kefu-testing-2020-02-14-2045-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 2 size: 30 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-kefu-testing-2020-02-14-2045 ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 mds: debug mgrc: 20 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug mgrc: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: a075f279f1948ef2c8122c5ac06d522688c3eb90 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: a075f279f1948ef2c8122c5ac06d522688c3eb90 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-kefu-testing-2020-02-14-2045 sha1: a075f279f1948ef2c8122c5ac06d522688c3eb90 owner: scheduled_kchai@teuthology priority: 30 repo: git://git.ceph.com/ceph-ci.git roles: - - mgr.x - mon.a - mon.c - mds.a - mds.c - osd.0 - client.0 - - mgr.y - mgr.z - mon.b - mds.b - osd.1 - osd.2 - osd.3 - client.1 sha1: a075f279f1948ef2c8122c5ac06d522688c3eb90 suite: rados suite_branch: wip-kefu-testing-2020-02-14-2045 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-02-14-2045/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: a075f279f1948ef2c8122c5ac06d522688c3eb90 tasks: - install: null - ceph: log-whitelist: - overall HEALTH_ - \(MGR_DOWN\) - \(PG_ - replacing it with standby - No standby daemons available - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_DOWN\) - \(OSD_HOST_DOWN\) - \(POOL_APP_NOT_ENABLED\) - \(OSDMAP_FLAGS\) - pauserd,pausewr flag\(s\) set - Monitor daemon marked osd\.[[:digit:]]+ down, but it is still running - evicting unresponsive client .+ wait-for-scrub: false - rgw: - client.0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.mgr.test_dashboard - tasks.mgr.dashboard.test_auth - tasks.mgr.dashboard.test_cephfs - tasks.mgr.dashboard.test_cluster_configuration - tasks.mgr.dashboard.test_erasure_code_profile - tasks.mgr.dashboard.test_ganesha - tasks.mgr.dashboard.test_health - tasks.mgr.dashboard.test_host - tasks.mgr.dashboard.test_logs - tasks.mgr.dashboard.test_mgr_module - tasks.mgr.dashboard.test_monitor - tasks.mgr.dashboard.test_orchestrator - tasks.mgr.dashboard.test_osd - tasks.mgr.dashboard.test_perf_counters - tasks.mgr.dashboard.test_pool - tasks.mgr.dashboard.test_rbd - tasks.mgr.dashboard.test_rbd_mirroring - tasks.mgr.dashboard.test_requests - tasks.mgr.dashboard.test_rgw - tasks.mgr.dashboard.test_role - tasks.mgr.dashboard.test_settings - tasks.mgr.dashboard.test_summary - tasks.mgr.dashboard.test_user teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.5510 2020-02-14T15:27:03.679 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-02-14-2045/qa; will attempt to use it 2020-02-14T15:27:03.679 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-02-14-2045/qa/tasks 2020-02-14T15:27:03.679 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-02-14T15:27:03.682 INFO:teuthology.task.internal:Checking packages... 2020-02-14T15:27:03.694 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'a075f279f1948ef2c8122c5ac06d522688c3eb90' 2020-02-14T15:27:03.695 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-02-14T15:27:03.695 INFO:teuthology.packaging:ref: None 2020-02-14T15:27:03.695 INFO:teuthology.packaging:tag: None 2020-02-14T15:27:03.695 INFO:teuthology.packaging:branch: wip-kefu-testing-2020-02-14-2045 2020-02-14T15:27:03.695 INFO:teuthology.packaging:sha1: a075f279f1948ef2c8122c5ac06d522688c3eb90 2020-02-14T15:27:03.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-kefu-testing-2020-02-14-2045 2020-02-14T15:27:03.896 INFO:teuthology.task.internal:Found packages for ceph version 15.1.0-735.ga075f27 2020-02-14T15:27:03.897 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-02-14T15:27:03.906 INFO:teuthology.task.internal:no buildpackages task found 2020-02-14T15:27:03.906 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-02-14T15:27:03.918 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-02-14T15:27:03.919 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-14T15:27:03.969 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:27:13.993 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:27:24.017 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:27:34.040 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:27:44.058 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:27:54.084 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:28:04.102 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:28:14.122 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:28:24.134 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:28:34.157 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:28:44.176 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:28:54.196 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:29:04.235 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:29:14.256 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:29:24.274 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:29:34.287 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:29:44.306 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:29:54.324 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:30:04.343 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:30:14.361 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:30:24.379 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:30:34.399 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:30:44.420 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:30:54.434 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:31:04.460 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:31:14.478 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:31:24.500 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:31:34.518 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:31:44.537 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:31:54.553 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:32:04.571 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:32:14.587 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:32:24.612 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:32:34.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:32:44.649 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:32:54.681 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:33:04.702 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:33:14.722 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:33:24.742 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:33:34.766 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:33:44.784 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:33:54.803 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:34:04.821 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:34:14.841 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:34:24.861 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:34:34.884 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:34:44.905 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-14T15:34:54.926 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:35:04.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:35:14.970 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:35:24.990 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:35:35.008 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:35:45.026 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:35:55.045 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:36:05.064 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:36:15.082 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:36:25.101 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-14T15:36:35.120 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:36:45.143 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:36:55.155 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-14T15:37:05.180 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_kchai@teuthology', 'description': '/home/teuthworker/archive/kchai-2020-02-14_15:08:49-rados-wip-kefu-testing-2020-02-14-2045-distro-basic-smithi/4763795', 'machine_type': 'smithi'} 2020-02-14T15:37:05.204 DEBUG:teuthology.lock.ops:locked ubuntu@smithi158.front.sepia.ceph.com, ubuntu@smithi100.front.sepia.ceph.com 2020-02-14T15:37:05.282 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-14T15:37:05.499 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.1 2020-02-14T15:37:05.565 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 8.1 2020-02-14T15:37:05.920 INFO:teuthology.orchestra.console:Power off smithi158 2020-02-14T15:37:05.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-14T15:37:05.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:06.029 INFO:teuthology.orchestra.console:Power off smithi100 2020-02-14T15:37:06.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-14T15:37:06.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:09.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:10.078 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:14.095 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:14.190 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:14.323 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2020-02-14T15:37:14.424 INFO:teuthology.orchestra.console:Power on smithi158 2020-02-14T15:37:14.424 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-14T15:37:14.449 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:18.310 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:18.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:18.521 INFO:teuthology.orchestra.console:Power off for smithi100 completed 2020-02-14T15:37:18.622 INFO:teuthology.orchestra.console:Power on smithi100 2020-02-14T15:37:18.622 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-14T15:37:18.643 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:22.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:22.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-14T15:37:22.818 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2020-02-14T15:37:22.879 INFO:teuthology.orchestra.console:Power on for smithi100 completed 2020-02-14T15:37:22.919 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2020-02-14T15:37:22.979 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2020-02-14T15:40:09.234 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:09.237 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:18.298 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:18.299 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:27.354 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:27.355 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:36.410 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:36.411 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:45.466 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:45.467 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:54.526 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:40:54.527 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:41:03.606 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:41:03.608 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:41:12.670 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:41:12.671 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:41:21.758 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:42:18.724 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:42:19.057 INFO:teuthology.orchestra.run.smithi158:> hostname 2020-02-14T15:42:19.347 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2020-02-14T15:42:19.348 INFO:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2020-02-14T15:42:19.362 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2020-02-14T15:42:19.363 INFO:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2020-02-14T15:42:19.481 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2020-02-14T15:42:19.509 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2020-02-14T15:42:19.577 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2020-02-14T15:42:19.645 INFO:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2020-02-14T15:42:19.712 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2020-02-14T15:42:19.714 DEBUG:teuthology.parallel:result is None 2020-02-14T15:42:27.764 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:42:28.103 INFO:teuthology.orchestra.run.smithi100:> hostname 2020-02-14T15:42:28.430 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2020-02-14T15:42:28.431 INFO:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2020-02-14T15:42:28.447 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2020-02-14T15:42:28.448 INFO:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2020-02-14T15:42:28.575 INFO:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2020-02-14T15:42:28.609 INFO:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2020-02-14T15:42:28.680 INFO:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2020-02-14T15:42:28.750 INFO:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2020-02-14T15:42:28.819 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2020-02-14T15:42:28.820 DEBUG:teuthology.parallel:result is None 2020-02-14T15:42:28.989 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2020-02-14T15:42:28.990 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-14T15:42:29.008 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2020-02-14T15:42:29.008 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-14T15:42:29.028 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2020-02-14T15:42:29.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-14T15:42:29.029 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:42:29.140 INFO:teuthology.orchestra.run.smithi158:> true 2020-02-14T15:42:29.313 INFO:teuthology.orchestra.run.smithi158:> uname -m 2020-02-14T15:42:29.367 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2020-02-14T15:42:29.368 INFO:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2020-02-14T15:42:29.425 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Linux" 2020-02-14T15:42:29.425 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8 (Core)" 2020-02-14T15:42:29.426 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2020-02-14T15:42:29.426 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2020-02-14T15:42:29.426 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2020-02-14T15:42:29.426 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2020-02-14T15:42:29.427 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-14T15:42:29.427 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2020-02-14T15:42:29.427 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-14T15:42:29.427 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.centos.org/" 2020-02-14T15:42:29.427 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-14T15:42:29.428 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:29.428 INFO:teuthology.orchestra.run.smithi158.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-14T15:42:29.428 INFO:teuthology.orchestra.run.smithi158.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-14T15:42:29.429 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-14T15:42:29.429 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-14T15:42:29.429 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:29.430 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2020-02-14T15:42:29.459 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2020-02-14T15:42:29.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-14T15:42:29.460 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:42:29.534 INFO:teuthology.orchestra.run.smithi100:> true 2020-02-14T15:42:29.700 INFO:teuthology.orchestra.run.smithi100:> uname -m 2020-02-14T15:42:29.754 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2020-02-14T15:42:29.755 INFO:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2020-02-14T15:42:29.808 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Linux" 2020-02-14T15:42:29.809 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8 (Core)" 2020-02-14T15:42:29.809 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2020-02-14T15:42:29.809 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2020-02-14T15:42:29.809 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8" 2020-02-14T15:42:29.809 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2020-02-14T15:42:29.809 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-14T15:42:29.809 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2020-02-14T15:42:29.810 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-14T15:42:29.810 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.centos.org/" 2020-02-14T15:42:29.810 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-14T15:42:29.810 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:29.810 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-14T15:42:29.810 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-14T15:42:29.810 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-14T15:42:29.810 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-14T15:42:29.811 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:29.811 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2020-02-14T15:42:29.826 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-02-14T15:42:29.860 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3wJNBqRW98d0sZ0AlvPCwSO/guHO4peZgDQ2nRWcXXuJMlgzQkuFm7mZGDyL1DsSY7MDPpypVC6EwYBePB7WDLubIVIjzwa5X7Sc3rFiLky1O3T8h2xpscgGqxMTe5Met24fCDGW1xERJ9edEaHzISTsfpSJPyheIyaseduU92c0mAJreULYc4W1t6Ts35jfvyZNqrSDT6VxC/Z6Lb4shX0XEGQjY2/Q4dVZvmsZoC5wQzSqRdPRY09MMsOWYKKXEUxruTA59/jfp0fTowkC+I+qhR7Zg+UUtXUpUV6cX43lbui9/yAThGMBfJN8sJOfF8K64NMGAvDRujK4Yx6hiWB/gS4ZRKXXk+6hF7NB7VxkoxRNg0pGO4yx6Kt1qtRF3KSB7VY0AUTP+q3BwxX3OSlHhnNf66KHr2oE52UpBPy+MUJPcDjb/jlidtwV6UG1uLWhYuxbaBLe/8Ab7oyHVmYdGJlDFxRu9mU5ec+ZTJKDWCodZD/mnTbQn1xugmXU= smithi158.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDadgeoR+B7zSib0xYObbkGAOz0HEeZe35FfQ0YoegdP1vdzZFdMiw2dOHQs88Zp6nEm10x+Uhba3/C8oXLLXml964oenG1KebpqHFH46ckZJUeDZLzYMOzMQRyAoiXjwqWau4x+vmDA30p81O+fu4oU12h9AuuLPfc/1Xu9brODu2jzpJiK61qFrPW6Yzt4u7xBJhQVbbvLRLjSzYFSjlD4irzJwlUUL5MAyF8B0nJ9ZEaZlp+tHbChWe9o376HYIWiy3Xm9xbSpHl2MB1AFphdOdq+q9ht5L5b65DV9tCNS76/f+LTJ5JZymeyAGpTxVlXq3wxkV1dsRCbeHGYdjPb6pAMWyWMxIU5do4HafdALtA9HFik60zbYOjXYE7n9M71QDq98sRfwBo2mxWfuRYLk3lapbwYUKRjPOcaK76dzxhi3DulFzkXLm6cMqARtzAM3MJuijcFOu5MLLDBZBjjP17GXG0yVtCC0dwSneB09ThexiA8hgXcVaxEGFDWqc= 2020-02-14T15:42:29.860 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-14T15:42:29.924 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-02-14T15:42:29.931 INFO:teuthology.task.internal:Saving configuration 2020-02-14T15:42:29.952 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-02-14T15:42:29.960 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-02-14T15:42:29.980 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-14 15:37:05.190808', u'locked_by': u'scheduled_kchai@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi158.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNcDV9tUJV3fMANRRjYFv7ORdWIOsq6TZ25JdCiyvWE5jGArXU5X6+xUREpK66JbFPEc75J3Ngo9XGX3D196NOM=', u'description': u'/home/teuthworker/archive/kchai-2020-02-14_15:08:49-rados-wip-kefu-testing-2020-02-14-2045-distro-basic-smithi/4763795'} 2020-02-14T15:42:30.000 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-14 15:37:05.190787', u'locked_by': u'scheduled_kchai@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi100.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/Y1VJ7oRnUnhY/zvTCoL6VOco2wcnFFh8Hp/+VJH3EPxfcTRLdzD0wYIlhK5HvscyVTqNa8XX8g87YUuQCojc=', u'description': u'/home/teuthworker/archive/kchai-2020-02-14_15:08:49-rados-wip-kefu-testing-2020-02-14-2045-distro-basic-smithi/4763795'} 2020-02-14T15:42:30.000 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-02-14T15:42:30.008 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'] 2020-02-14T15:42:30.008 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1'] 2020-02-14T15:42:30.008 INFO:teuthology.run_tasks:Running task console_log... 2020-02-14T15:42:30.100 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-14T15:42:30.101 INFO:teuthology.run_tasks:Running task internal.connect... 2020-02-14T15:42:30.111 INFO:teuthology.task.internal:Opening connections... 2020-02-14T15:42:30.111 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2020-02-14T15:42:30.113 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:42:30.187 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2020-02-14T15:42:30.188 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:42:30.261 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-02-14T15:42:30.275 INFO:teuthology.orchestra.run.smithi158:> uname -m 2020-02-14T15:42:30.309 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2020-02-14T15:42:30.309 INFO:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2020-02-14T15:42:30.362 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Linux" 2020-02-14T15:42:30.362 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8 (Core)" 2020-02-14T15:42:30.362 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2020-02-14T15:42:30.362 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2020-02-14T15:42:30.362 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2020-02-14T15:42:30.363 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2020-02-14T15:42:30.363 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-14T15:42:30.363 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2020-02-14T15:42:30.363 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-14T15:42:30.363 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.centos.org/" 2020-02-14T15:42:30.363 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-14T15:42:30.363 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:30.364 INFO:teuthology.orchestra.run.smithi158.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-14T15:42:30.364 INFO:teuthology.orchestra.run.smithi158.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-14T15:42:30.364 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-14T15:42:30.364 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-14T15:42:30.364 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:30.364 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2020-02-14T15:42:30.386 INFO:teuthology.orchestra.run.smithi100:> uname -m 2020-02-14T15:42:30.400 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2020-02-14T15:42:30.401 INFO:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2020-02-14T15:42:30.454 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Linux" 2020-02-14T15:42:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8 (Core)" 2020-02-14T15:42:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2020-02-14T15:42:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2020-02-14T15:42:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8" 2020-02-14T15:42:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2020-02-14T15:42:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-14T15:42:30.456 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2020-02-14T15:42:30.456 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-14T15:42:30.456 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.centos.org/" 2020-02-14T15:42:30.456 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-14T15:42:30.456 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:30.456 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-14T15:42:30.456 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-14T15:42:30.456 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-14T15:42:30.457 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-14T15:42:30.457 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:30.457 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2020-02-14T15:42:30.475 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-02-14T15:42:30.506 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-02-14T15:42:30.550 INFO:teuthology.task.internal:Checking for old test directory... 2020-02-14T15:42:30.550 INFO:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2020-02-14T15:42:30.553 INFO:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2020-02-14T15:42:30.566 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-02-14T15:42:30.609 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-02-14T15:42:30.609 INFO:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2020-02-14T15:42:30.612 INFO:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2020-02-14T15:42:30.631 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-02-14T15:42:30.683 INFO:teuthology.run_tasks:Running task kernel... 2020-02-14T15:42:30.708 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.c': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'mgr.z': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2020-02-14T15:42:30.709 INFO:teuthology.task.kernel:config {'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-02-14T15:42:30.709 INFO:teuthology.orchestra.run.smithi100:> uname -r 2020-02-14T15:42:30.723 INFO:teuthology.orchestra.run.smithi100.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-02-14T15:42:30.723 INFO:teuthology.task.kernel:Running kernel on smithi100: 4.18.0-147.5.1.el8_1.x86_64 2020-02-14T15:42:30.724 INFO:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2020-02-14T15:42:33.316 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - AppStream 10 kB/s | 4.3 kB 00:00 2020-02-14T15:42:33.650 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - Base 16 kB/s | 3.8 kB 00:00 2020-02-14T15:42:33.946 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-8 - Extras 6.4 kB/s | 1.5 kB 00:00 2020-02-14T15:42:34.193 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for ceph-el8 owned by ktdreyer 14 kB/s | 3.3 kB 00:00 2020-02-14T15:42:34.746 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for ceph-el8 owned by ktdreyer 68 kB/s | 38 kB 00:00 2020-02-14T15:42:34.897 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 79 kB/s | 5.3 kB 00:00 2020-02-14T15:42:35.110 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 27 MB/s | 5.7 MB 00:00 2020-02-14T15:42:36.316 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 1.2 MB/s | 2.9 kB 00:00 2020-02-14T15:42:36.859 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-02-14T15:42:36.859 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-02-14T15:42:37.010 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2020-02-14T15:42:37.012 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2020-02-14T15:42:37.012 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2020-02-14T15:42:37.133 INFO:teuthology.orchestra.run.smithi100:> echo no | sudo yum reinstall kernel || true 2020-02-14T15:42:37.565 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:01 ago on Fri 14 Feb 2020 03:42:36 PM UTC. 2020-02-14T15:42:37.912 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2020-02-14T15:42:37.913 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-02-14T15:42:37.913 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2020-02-14T15:42:37.913 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-02-14T15:42:37.913 INFO:teuthology.orchestra.run.smithi100.stdout:Reinstalling: 2020-02-14T15:42:37.913 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-14T15:42:37.914 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-14T15:42:37.914 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:37.914 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2020-02-14T15:42:37.914 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-02-14T15:42:37.914 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:37.915 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 3.1 M 2020-02-14T15:42:37.915 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 0 2020-02-14T15:42:37.915 INFO:teuthology.orchestra.run.smithi100.stderr:Operation aborted. 2020-02-14T15:42:38.031 INFO:teuthology.orchestra.run.smithi100.stdout:Is this ok [y/N]: 2020-02-14T15:42:38.032 INFO:teuthology.orchestra.run.smithi100:> sudo yum reinstall -y kernel || true 2020-02-14T15:42:38.414 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:02 ago on Fri 14 Feb 2020 03:42:36 PM UTC. 2020-02-14T15:42:38.760 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2020-02-14T15:42:38.761 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-02-14T15:42:38.761 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2020-02-14T15:42:38.761 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-02-14T15:42:38.761 INFO:teuthology.orchestra.run.smithi100.stdout:Reinstalling: 2020-02-14T15:42:38.761 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-14T15:42:38.761 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-14T15:42:38.761 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:38.762 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2020-02-14T15:42:38.762 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2020-02-14T15:42:38.762 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:38.762 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 3.1 M 2020-02-14T15:42:38.763 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 0 2020-02-14T15:42:38.763 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2020-02-14T15:42:39.120 INFO:teuthology.orchestra.run.smithi100.stdout:(1/2): kernel-4.18.0-147.el8.x86_64.rpm 8.9 MB/s | 1.5 MB 00:00 2020-02-14T15:42:39.127 INFO:teuthology.orchestra.run.smithi100.stdout:(2/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 8.7 MB/s | 1.5 MB 00:00 2020-02-14T15:42:39.127 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2020-02-14T15:42:39.127 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.4 MB/s | 3.1 MB 00:00 2020-02-14T15:42:39.150 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2020-02-14T15:42:39.321 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2020-02-14T15:42:39.321 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2020-02-14T15:42:39.392 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2020-02-14T15:42:39.392 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2020-02-14T15:42:39.554 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2020-02-14T15:42:39.692 INFO:teuthology.orchestra.run.smithi100.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-02-14T15:42:39.809 INFO:teuthology.orchestra.run.smithi100.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-14T15:42:39.810 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-14T15:42:39.910 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-02-14T15:42:39.910 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-14T15:42:40.133 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-14T15:42:40.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-02-14T15:42:40.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-14T15:42:40.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-02-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi100.stdout:Reinstalled: 2020-02-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-02-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2020-02-14T15:42:40.492 INFO:teuthology.orchestra.run.smithi100:> rpm -q kernel --last | head -n 1 2020-02-14T15:42:40.598 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-4.18.0-147.el8.x86_64 Fri 14 Feb 2020 03:42:39 PM UTC 2020-02-14T15:42:40.599 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-14T15:42:40.599 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-02-14T15:42:40.599 INFO:teuthology.orchestra.run.smithi158:> uname -r 2020-02-14T15:42:40.618 INFO:teuthology.orchestra.run.smithi158.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-02-14T15:42:40.618 INFO:teuthology.task.kernel:Running kernel on smithi158: 4.18.0-147.5.1.el8_1.x86_64 2020-02-14T15:42:40.619 INFO:teuthology.orchestra.run.smithi158:> sudo yum install -y kernel 2020-02-14T15:42:43.453 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS-8 - AppStream 10 kB/s | 4.3 kB 00:00 2020-02-14T15:42:43.783 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS-8 - Base 17 kB/s | 3.8 kB 00:00 2020-02-14T15:42:43.959 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS-8 - Extras 15 kB/s | 1.5 kB 00:00 2020-02-14T15:42:44.211 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for ceph-el8 owned by ktdreyer 15 kB/s | 3.3 kB 00:00 2020-02-14T15:42:44.538 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for ceph-el8 owned by ktdreyer 116 kB/s | 38 kB 00:00 2020-02-14T15:42:44.668 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 114 kB/s | 5.3 kB 00:00 2020-02-14T15:42:44.882 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 27 MB/s | 5.7 MB 00:00 2020-02-14T15:42:46.110 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 1.2 MB/s | 2.9 kB 00:00 2020-02-14T15:42:46.622 INFO:teuthology.orchestra.run.smithi158.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-02-14T15:42:46.622 INFO:teuthology.orchestra.run.smithi158.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-02-14T15:42:46.769 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2020-02-14T15:42:46.770 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2020-02-14T15:42:46.770 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2020-02-14T15:42:46.888 INFO:teuthology.orchestra.run.smithi158:> echo no | sudo yum reinstall kernel || true 2020-02-14T15:42:47.324 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:00:01 ago on Fri 14 Feb 2020 03:42:46 PM UTC. 2020-02-14T15:42:47.683 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2020-02-14T15:42:47.684 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2020-02-14T15:42:47.684 INFO:teuthology.orchestra.run.smithi158.stdout: Package Architecture Version Repository Size 2020-02-14T15:42:47.684 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2020-02-14T15:42:47.684 INFO:teuthology.orchestra.run.smithi158.stdout:Reinstalling: 2020-02-14T15:42:47.685 INFO:teuthology.orchestra.run.smithi158.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-14T15:42:47.685 INFO:teuthology.orchestra.run.smithi158.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-14T15:42:47.685 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:47.685 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2020-02-14T15:42:47.685 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2020-02-14T15:42:47.685 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:47.686 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 3.1 M 2020-02-14T15:42:47.686 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 0 2020-02-14T15:42:47.686 INFO:teuthology.orchestra.run.smithi158.stderr:Operation aborted. 2020-02-14T15:42:47.778 INFO:teuthology.orchestra.run.smithi158.stdout:Is this ok [y/N]: 2020-02-14T15:42:47.778 INFO:teuthology.orchestra.run.smithi158:> sudo yum reinstall -y kernel || true 2020-02-14T15:42:48.163 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:00:02 ago on Fri 14 Feb 2020 03:42:46 PM UTC. 2020-02-14T15:42:48.522 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2020-02-14T15:42:48.522 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2020-02-14T15:42:48.523 INFO:teuthology.orchestra.run.smithi158.stdout: Package Architecture Version Repository Size 2020-02-14T15:42:48.523 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2020-02-14T15:42:48.523 INFO:teuthology.orchestra.run.smithi158.stdout:Reinstalling: 2020-02-14T15:42:48.523 INFO:teuthology.orchestra.run.smithi158.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-14T15:42:48.523 INFO:teuthology.orchestra.run.smithi158.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-14T15:42:48.523 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:48.523 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2020-02-14T15:42:48.523 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2020-02-14T15:42:48.524 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:48.524 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 3.1 M 2020-02-14T15:42:48.524 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 0 2020-02-14T15:42:48.524 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2020-02-14T15:42:48.917 INFO:teuthology.orchestra.run.smithi158.stdout:(1/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 9.3 MB/s | 1.5 MB 00:00 2020-02-14T15:42:48.933 INFO:teuthology.orchestra.run.smithi158.stdout:(2/2): kernel-4.18.0-147.el8.x86_64.rpm 8.4 MB/s | 1.5 MB 00:00 2020-02-14T15:42:48.933 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2020-02-14T15:42:48.933 INFO:teuthology.orchestra.run.smithi158.stdout:Total 7.5 MB/s | 3.1 MB 00:00 2020-02-14T15:42:48.956 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2020-02-14T15:42:49.127 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2020-02-14T15:42:49.127 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2020-02-14T15:42:49.216 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2020-02-14T15:42:49.216 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2020-02-14T15:42:49.365 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2020-02-14T15:42:49.538 INFO:teuthology.orchestra.run.smithi158.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-02-14T15:42:49.654 INFO:teuthology.orchestra.run.smithi158.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-14T15:42:49.654 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-14T15:42:49.762 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-02-14T15:42:49.763 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-14T15:42:49.978 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-14T15:42:49.978 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-02-14T15:42:49.979 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-14T15:42:49.979 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-14T15:42:50.207 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-02-14T15:42:50.208 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:50.208 INFO:teuthology.orchestra.run.smithi158.stdout:Reinstalled: 2020-02-14T15:42:50.208 INFO:teuthology.orchestra.run.smithi158.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-02-14T15:42:50.208 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:50.209 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2020-02-14T15:42:50.303 INFO:teuthology.orchestra.run.smithi158:> rpm -q kernel --last | head -n 1 2020-02-14T15:42:50.357 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-4.18.0-147.el8.x86_64 Fri 14 Feb 2020 03:42:49 PM UTC 2020-02-14T15:42:50.358 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-14T15:42:50.359 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-02-14T15:42:50.359 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-02-14T15:42:50.359 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-02-14T15:42:50.359 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-02-14T15:42:50.359 INFO:teuthology.task.kernel:Installing distro kernel on mgr.y... 2020-02-14T15:42:50.359 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2020-02-14T15:42:50.359 INFO:teuthology.orchestra.run.smithi100:> rpm -q kernel --last | head -n 1 2020-02-14T15:42:50.406 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-4.18.0-147.el8.x86_64 Fri 14 Feb 2020 03:42:39 PM UTC 2020-02-14T15:42:50.407 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-14T15:42:50.408 INFO:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2020-02-14T15:42:50.482 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2020-02-14T15:42:50.482 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2020-02-14T15:42:50.482 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.02 2020-02-14T15:42:50.482 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 78.el8 2020-02-14T15:42:50.482 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2020-02-14T15:42:50.483 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Tue 11 Feb 2020 03:32:52 PM UTC 2020-02-14T15:42:50.483 INFO:teuthology.orchestra.run.smithi100.stdout:Group : System Environment/Base 2020-02-14T15:42:50.483 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 9192691 2020-02-14T15:42:50.483 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2020-02-14T15:42:50.483 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-02-14T15:42:50.483 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-02-14T15:42:50.483 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-02-14T15:42:50.484 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : kbuilder.bsys.centos.org 2020-02-14T15:42:50.484 INFO:teuthology.orchestra.run.smithi100.stdout:Relocations : (not relocatable) 2020-02-14T15:42:50.484 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : CentOS BuildSystem 2020-02-14T15:42:50.484 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2020-02-14T15:42:50.484 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2020-02-14T15:42:50.484 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2020-02-14T15:42:50.485 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2020-02-14T15:42:50.485 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:50.485 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-02-14T15:42:50.485 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2020-02-14T15:42:50.485 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2020-02-14T15:42:50.486 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2020-02-14T15:42:50.486 INFO:teuthology.orchestra.run.smithi100.stdout: 2020-02-14T15:42:50.486 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2020-02-14T15:42:50.487 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-02-14T15:42:50.488 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 4.18.0-147.el8.x86_64 2020-02-14T15:42:50.488 INFO:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-02-14T15:42:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2020-02-14T15:42:53.987 INFO:teuthology.orchestra.run.smithi100.stderr:done 2020-02-14T15:42:53.987 INFO:teuthology.orchestra.run.smithi100:> mktemp 2020-02-14T15:42:54.019 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.pFA9aKZJ06 2020-02-14T15:42:54.020 INFO:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pFA9aKZJ06 2020-02-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.pFA9aKZJ06 2020-02-14T15:42:54.753 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.pFA9aKZJ06 is 4KB 2020-02-14T15:42:54.802 INFO:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.pFA9aKZJ06 2020-02-14T15:42:54.816 INFO:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2020-02-14T15:42:54.904 INFO:teuthology.orchestra.run.smithi100.stdout:64c9091786944d63a01cf35d7b3c4063-0-rescue.conf 2020-02-14T15:42:54.904 INFO:teuthology.orchestra.run.smithi100.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.5.1.el8_1.x86_64.conf 2020-02-14T15:42:54.904 INFO:teuthology.orchestra.run.smithi100.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64.conf 2020-02-14T15:42:54.906 INFO:teuthology.orchestra.run.smithi100:> sudo grub2-set-default 64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64 2020-02-14T15:42:55.044 INFO:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2020-02-14T15:42:55.046 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2020-02-14T15:42:55.047 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi158.front.sepia.ceph.com, path=None, version=distro) 2020-02-14T15:42:55.047 INFO:teuthology.orchestra.run.smithi158:> rpm -q kernel --last | head -n 1 2020-02-14T15:42:55.094 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-4.18.0-147.el8.x86_64 Fri 14 Feb 2020 03:42:49 PM UTC 2020-02-14T15:42:55.096 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-14T15:42:55.096 INFO:teuthology.orchestra.run.smithi158:> sudo rpm -qi grub2-tools 2020-02-14T15:42:55.131 INFO:teuthology.orchestra.run.smithi158.stdout:Name : grub2-tools 2020-02-14T15:42:55.131 INFO:teuthology.orchestra.run.smithi158.stdout:Epoch : 1 2020-02-14T15:42:55.131 INFO:teuthology.orchestra.run.smithi158.stdout:Version : 2.02 2020-02-14T15:42:55.131 INFO:teuthology.orchestra.run.smithi158.stdout:Release : 78.el8 2020-02-14T15:42:55.131 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: x86_64 2020-02-14T15:42:55.132 INFO:teuthology.orchestra.run.smithi158.stdout:Install Date: Tue 11 Feb 2020 03:32:52 PM UTC 2020-02-14T15:42:55.132 INFO:teuthology.orchestra.run.smithi158.stdout:Group : System Environment/Base 2020-02-14T15:42:55.132 INFO:teuthology.orchestra.run.smithi158.stdout:Size : 9192691 2020-02-14T15:42:55.132 INFO:teuthology.orchestra.run.smithi158.stdout:License : GPLv3+ 2020-02-14T15:42:55.132 INFO:teuthology.orchestra.run.smithi158.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-02-14T15:42:55.132 INFO:teuthology.orchestra.run.smithi158.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-02-14T15:42:55.132 INFO:teuthology.orchestra.run.smithi158.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-02-14T15:42:55.132 INFO:teuthology.orchestra.run.smithi158.stdout:Build Host : kbuilder.bsys.centos.org 2020-02-14T15:42:55.133 INFO:teuthology.orchestra.run.smithi158.stdout:Relocations : (not relocatable) 2020-02-14T15:42:55.133 INFO:teuthology.orchestra.run.smithi158.stdout:Packager : CentOS BuildSystem 2020-02-14T15:42:55.133 INFO:teuthology.orchestra.run.smithi158.stdout:Vendor : CentOS 2020-02-14T15:42:55.133 INFO:teuthology.orchestra.run.smithi158.stdout:URL : http://www.gnu.org/software/grub/ 2020-02-14T15:42:55.133 INFO:teuthology.orchestra.run.smithi158.stdout:Summary : Support tools for GRUB. 2020-02-14T15:42:55.133 INFO:teuthology.orchestra.run.smithi158.stdout:Description : 2020-02-14T15:42:55.133 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:55.134 INFO:teuthology.orchestra.run.smithi158.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-02-14T15:42:55.134 INFO:teuthology.orchestra.run.smithi158.stdout:customizable bootloader with modular architecture. It supports a rich 2020-02-14T15:42:55.134 INFO:teuthology.orchestra.run.smithi158.stdout:variety of kernel formats, file systems, computer architectures and 2020-02-14T15:42:55.134 INFO:teuthology.orchestra.run.smithi158.stdout:hardware devices. 2020-02-14T15:42:55.134 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-02-14T15:42:55.134 INFO:teuthology.orchestra.run.smithi158.stdout:This subpackage provides tools for support of all platforms. 2020-02-14T15:42:55.135 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-02-14T15:42:55.135 INFO:teuthology.task.kernel:Updating grub on smithi158 to boot 4.18.0-147.el8.x86_64 2020-02-14T15:42:55.135 INFO:teuthology.orchestra.run.smithi158:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-02-14T15:42:56.091 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2020-02-14T15:42:58.288 INFO:teuthology.orchestra.run.smithi158.stderr:done 2020-02-14T15:42:58.290 INFO:teuthology.orchestra.run.smithi158:> mktemp 2020-02-14T15:42:58.316 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.89NDs5s8jw 2020-02-14T15:42:58.317 INFO:teuthology.orchestra.run.smithi158:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.89NDs5s8jw 2020-02-14T15:42:58.390 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.89NDs5s8jw 2020-02-14T15:42:58.557 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.89NDs5s8jw is 4KB 2020-02-14T15:42:58.581 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.89NDs5s8jw 2020-02-14T15:42:58.599 INFO:teuthology.orchestra.run.smithi158:> sudo /bin/ls /boot/loader/entries || true 2020-02-14T15:42:58.672 INFO:teuthology.orchestra.run.smithi158.stdout:64c9091786944d63a01cf35d7b3c4063-0-rescue.conf 2020-02-14T15:42:58.673 INFO:teuthology.orchestra.run.smithi158.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.5.1.el8_1.x86_64.conf 2020-02-14T15:42:58.673 INFO:teuthology.orchestra.run.smithi158.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64.conf 2020-02-14T15:42:58.674 INFO:teuthology.orchestra.run.smithi158:> sudo grub2-set-default 64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64 2020-02-14T15:42:58.841 INFO:teuthology.orchestra.run.smithi158:> sudo shutdown -r now 2020-02-14T15:42:58.853 INFO:teuthology.misc:Re-opening connections... 2020-02-14T15:42:58.853 INFO:teuthology.misc:trying to connect to ubuntu@smithi158.front.sepia.ceph.com 2020-02-14T15:42:58.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-14T15:42:58.855 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:42:58.974 INFO:teuthology.orchestra.run.smithi158:> true 2020-02-14T15:42:59.176 DEBUG:teuthology.misc:waited 0.323282003403 2020-02-14T15:43:00.178 INFO:teuthology.misc:trying to connect to ubuntu@smithi100.front.sepia.ceph.com 2020-02-14T15:43:00.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-14T15:43:00.179 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi100.front.sepia.ceph.com', 'timeout': 60} 2020-02-14T15:43:59.747 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-02-14T15:43:59.748 DEBUG:teuthology.task.console_log:Killing console logger for smithi158 2020-02-14T15:43:59.748 DEBUG:teuthology.task.console_log:Killing console logger for smithi100 2020-02-14T15:43:59.748 DEBUG:teuthology.task.console_log:Killing console logger for smithi158 2020-02-14T15:43:59.749 DEBUG:teuthology.task.console_log:Killing console logger for smithi100 2020-02-14T15:43:59.749 DEBUG:teuthology.exit:Finished running handlers