2020-03-27T16:00:53.647 INFO:root:teuthology version: 1.0.0-b3a6b1a 2020-03-27T16:00:53.647 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.tMgR0f.tmp -- --verbose --lock --description rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} --name sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895547 2020-03-27T16:00:53.681 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-03-27T16:00:53.735 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895547 branch: revert-dec description: rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} email: null first_in_suite: false job_id: '4895547' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - volumes: count: 4 size: 10 os_type: centos os_version: '7.6' overrides: admin_socket: branch: revert-dec ceph: conf: client.2: debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd debug verify cached snaps: true osd debug verify missing on start: true osd heartbeat use min delay socket: true osd max markdown count: 1000 osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: min_in: 4 workunit: branch: revert-dec sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c owner: scheduled_sage@teuthology priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - - mon.c - osd.8 - osd.9 - osd.10 - osd.11 - client.2 sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c suite: rados:thrash-old-clients suite_branch: revert-dec suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_revert-dec/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c tasks: - install: branch: nautilus exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs - cephadm: null - full_sequential: - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.27851 2020-03-27T16:00:53.735 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_revert-dec/qa; will attempt to use it 2020-03-27T16:00:53.736 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_revert-dec/qa/tasks 2020-03-27T16:00:53.736 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-03-27T16:00:53.737 INFO:teuthology.task.internal:Checking packages... 2020-03-27T16:00:53.749 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '04af5888e1368740ebb4403bab567f8cfd92df6c' 2020-03-27T16:00:53.749 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-03-27T16:00:53.749 INFO:teuthology.packaging:ref: None 2020-03-27T16:00:53.749 INFO:teuthology.packaging:tag: None 2020-03-27T16:00:53.750 INFO:teuthology.packaging:branch: revert-dec 2020-03-27T16:00:53.750 INFO:teuthology.packaging:sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c 2020-03-27T16:00:53.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=revert-dec 2020-03-27T16:00:53.963 INFO:teuthology.task.internal:Found packages for ceph version 15.2.0-377.g04af588 2020-03-27T16:00:53.963 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-03-27T16:00:53.973 INFO:teuthology.task.internal:no buildpackages task found 2020-03-27T16:00:53.973 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-03-27T16:00:53.987 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-03-27T16:00:53.987 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-03-27T16:00:54.040 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:04.057 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:14.072 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:24.089 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:34.100 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:44.118 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:54.134 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:04.143 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:14.160 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:24.175 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:34.190 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:44.200 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:54.217 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:04.233 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:14.250 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:24.265 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:34.276 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:44.294 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:54.308 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:04.325 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:14.340 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:24.352 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:34.366 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:44.381 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:54.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:04.414 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:14.429 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:24.444 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:34.454 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:44.471 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:54.481 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:04.500 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:14.517 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:24.533 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:34.552 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:44.571 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:54.595 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:04.617 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:14.637 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:24.657 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:34.683 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:44.698 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:54.715 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:04.732 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:14.750 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:24.771 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:34.780 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:44.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:54.816 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:04.828 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:14.844 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:24.860 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:34.876 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:44.889 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:54.907 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:04.937 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:14.947 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:24.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:34.972 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:44.983 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:55.000 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:05.010 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:15.028 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:25.045 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:35.061 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:45.076 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:55.094 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:05.119 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:15.138 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:25.155 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:35.174 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:45.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:55.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:05.232 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:15.249 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:25.268 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:35.286 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:45.296 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:55.314 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:05.333 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:15.350 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2020-03-27T16:14:25.369 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:35.386 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:45.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:55.422 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:05.440 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:15.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:25.475 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:35.492 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:45.510 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:55.525 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:05.540 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:15.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:25.571 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:35.585 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:45.601 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:55.613 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:05.630 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:15.648 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:25.665 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:35.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:45.695 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:55.713 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:05.726 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:15.743 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:25.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:35.776 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:45.794 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895547', 'machine_type': 'smithi'} 2020-03-27T16:18:45.819 DEBUG:teuthology.lock.ops:locked ubuntu@smithi194.front.sepia.ceph.com, ubuntu@smithi023.front.sepia.ceph.com, ubuntu@smithi156.front.sepia.ceph.com 2020-03-27T16:18:45.896 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-03-27T16:18:46.095 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 7.6 2020-03-27T16:18:46.098 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 7.6 2020-03-27T16:18:46.101 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 7.6 2020-03-27T16:18:46.413 INFO:teuthology.orchestra.console:Power off smithi194 2020-03-27T16:18:46.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-03-27T16:18:46.426 INFO:teuthology.orchestra.console:Power off smithi156 2020-03-27T16:18:46.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-03-27T16:18:46.440 INFO:teuthology.orchestra.console:Power off smithi023 2020-03-27T16:18:46.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-03-27T16:18:46.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:46.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:46.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:50.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:50.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:50.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:54.581 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:54.589 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:54.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:54.791 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2020-03-27T16:18:54.797 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2020-03-27T16:18:54.892 INFO:teuthology.orchestra.console:Power on smithi194 2020-03-27T16:18:54.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-03-27T16:18:54.901 INFO:teuthology.orchestra.console:Power on smithi156 2020-03-27T16:18:54.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-03-27T16:18:54.914 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:54.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:58.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:58.917 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2020-03-27T16:18:58.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:58.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:59.017 INFO:teuthology.orchestra.console:Power on smithi023 2020-03-27T16:18:59.018 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-03-27T16:18:59.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:19:03.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:19:03.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:19:03.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:19:03.259 INFO:teuthology.orchestra.console:Power on for smithi194 completed 2020-03-27T16:19:03.266 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2020-03-27T16:19:03.272 INFO:teuthology.orchestra.console:Power on for smithi023 completed 2020-03-27T16:19:03.360 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2020-03-27T16:19:03.367 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2020-03-27T16:19:03.374 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2020-03-27T16:21:34.369 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:21:34.373 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:21:43.438 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:21:43.440 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:21:52.518 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:21:52.519 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:01.577 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:01.578 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:04.487 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:10.636 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:10.638 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:13.544 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:19.718 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:19.719 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:22.598 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:28.775 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:28.777 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:31.655 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:37.830 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:40.710 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:49.774 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:58.859 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:06.314 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:06.526 INFO:teuthology.orchestra.run.smithi194:> hostname 2020-03-27T16:23:06.943 INFO:teuthology.orchestra.run.smithi194.stdout:smithi125 2020-03-27T16:23:06.944 INFO:teuthology.orchestra.run.smithi194:> grep smithi125 /etc/hosts 2020-03-27T16:23:06.986 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2020-03-27T16:23:06.986 INFO:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2020-03-27T16:23:07.079 INFO:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi125/smithi194/g' /etc/hosts 2020-03-27T16:23:07.135 INFO:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.125/172.21.15.194/g' /etc/hosts 2020-03-27T16:23:07.190 INFO:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi125/smithi194/g' /etc/hostname 2020-03-27T16:23:07.241 INFO:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2020-03-27T16:23:07.293 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2020-03-27T16:23:07.295 DEBUG:teuthology.parallel:result is None 2020-03-27T16:23:07.910 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:16.970 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:26.025 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:43.843 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:44.069 INFO:teuthology.orchestra.run.smithi156:> hostname 2020-03-27T16:23:44.626 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2020-03-27T16:23:44.626 INFO:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2020-03-27T16:23:44.712 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2020-03-27T16:23:44.713 INFO:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2020-03-27T16:23:44.864 INFO:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2020-03-27T16:23:44.965 INFO:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2020-03-27T16:23:45.045 INFO:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2020-03-27T16:23:45.121 INFO:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2020-03-27T16:23:45.188 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2020-03-27T16:23:45.189 DEBUG:teuthology.parallel:result is None 2020-03-27T16:24:32.035 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:32.265 INFO:teuthology.orchestra.run.smithi023:> hostname 2020-03-27T16:24:32.800 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2020-03-27T16:24:32.801 INFO:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2020-03-27T16:24:32.889 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2020-03-27T16:24:32.889 INFO:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2020-03-27T16:24:33.055 INFO:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2020-03-27T16:24:33.175 INFO:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2020-03-27T16:24:33.285 INFO:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2020-03-27T16:24:33.374 INFO:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2020-03-27T16:24:33.473 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2020-03-27T16:24:33.475 DEBUG:teuthology.parallel:result is None 2020-03-27T16:24:33.750 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2020-03-27T16:24:33.751 INFO:teuthology.lock.ops:New key found. Updating... 2020-03-27T16:24:33.770 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2020-03-27T16:24:33.771 INFO:teuthology.lock.ops:New key found. Updating... 2020-03-27T16:24:33.786 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2020-03-27T16:24:33.786 INFO:teuthology.lock.ops:New key found. Updating... 2020-03-27T16:24:33.803 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2020-03-27T16:24:33.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:24:33.805 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:33.904 INFO:teuthology.orchestra.run.smithi023:> true 2020-03-27T16:24:34.290 INFO:teuthology.orchestra.run.smithi023:> uname -m 2020-03-27T16:24:34.370 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2020-03-27T16:24:34.370 INFO:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2020-03-27T16:24:34.444 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Linux" 2020-03-27T16:24:34.444 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="7 (Core)" 2020-03-27T16:24:34.444 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2020-03-27T16:24:34.444 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:34.444 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="7" 2020-03-27T16:24:34.445 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:34.445 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:34.445 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:34.445 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:34.445 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:34.445 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:24:34.446 INFO:teuthology.orchestra.run.smithi023.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:34.446 INFO:teuthology.orchestra.run.smithi023.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:34.446 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:34.446 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:34.446 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:24:34.447 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2020-03-27T16:24:34.467 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2020-03-27T16:24:34.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:24:34.468 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:34.566 INFO:teuthology.orchestra.run.smithi156:> true 2020-03-27T16:24:34.961 INFO:teuthology.orchestra.run.smithi156:> uname -m 2020-03-27T16:24:35.016 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2020-03-27T16:24:35.017 INFO:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2020-03-27T16:24:35.071 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Linux" 2020-03-27T16:24:35.071 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="7 (Core)" 2020-03-27T16:24:35.071 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2020-03-27T16:24:35.071 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:35.072 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="7" 2020-03-27T16:24:35.072 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:35.072 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:35.072 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:35.072 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:35.072 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:24:35.073 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:35.073 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:35.073 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:35.073 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:24:35.074 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2020-03-27T16:24:35.090 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2020-03-27T16:24:35.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:24:35.090 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:35.189 INFO:teuthology.orchestra.run.smithi194:> true 2020-03-27T16:24:35.607 INFO:teuthology.orchestra.run.smithi194:> uname -m 2020-03-27T16:24:35.676 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2020-03-27T16:24:35.677 INFO:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2020-03-27T16:24:35.747 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Linux" 2020-03-27T16:24:35.748 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="7 (Core)" 2020-03-27T16:24:35.748 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2020-03-27T16:24:35.748 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:35.748 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="7" 2020-03-27T16:24:35.748 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:35.748 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:35.749 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:35.749 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:35.749 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:35.749 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:24:35.749 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:35.749 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:35.750 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:35.750 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:35.750 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:24:35.750 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2020-03-27T16:24:35.771 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-03-27T16:24:35.828 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDB2/CNZtgeS0hjm++rpnpFn2o3Jk1RfX0YU3O0rXtMG+kgyocN8FRv0EVztkFlTOWkSf3c8bR9Dktaf6UebgSsYpnDRWPixzmv1N5nxp63lNDptkn233ibw1n6+bSA9zL6zEwmQH5SPjJNiTZZ/CUH/SEygFSGjl39ZY4Y4iNb46/uyMhhb1wthaUGErSav/4IJkwlkaeA3YVYWnL8ZSCRiYmi1EB5mk6eELB78Czst3i3IRMI708g2CBkh2oRU162fz+H0w4utlP97Zdjjem7pISeTKSafPOs10RU19ZVJwWqo+bpo0O45tQttMadpzkYWdWEg5BNYdtIFbkjNDXt smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzdlFrH8fEKH8VYrBWvME8H3Rt1+g+cKoVblA5uhkIc9zZl9AD5gm15muxLx3G/Iuk80gAqe7ZdyNQgQGADrcEV14r/93UMR8CHhtIDeAvMDrbsOrt/t4saS6BJd4qKjiqmXW1v9AiO+Eq15ak+40XcON2nv7cnAPo7liCHBMgEaCMXhsAVl39MANNlLZ/+FPoEXteaph3ILV5X+fQGMnRDOasKcoLf/8T03I4Iawj7Z8hgsifGAJ1J7lNPeB9MDMoJvLM2oXJhValM++1TM1h9oylyq4XnDbQqB060wtVWPa7KvSpRW6PVfK+DfuzI4HXkxweX8D90FnziH9do7tP smithi194.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvHB6CXJI94CABhme7h0yosL3R9f2L07vBnyfQZwhgd93yYBRGhoNH0Oo4EJNs0rxJovXur+FQGFDpoDeoWzYGmGJsHqAZg1fz0YjHWgCdEvA7OFXw+Sdh8UvrC18ZBOmfLf+9nr8HLxwn9uzGHCY/xs+B9lY2hJw1oPrm/PJcE/tOqjFpXg18Em/DnXVIY860eGurmauotTr0fOAlh5KeAtVm1xwNtXkaGxR1DiyCrRrXtplCHy8QKyvoCOzDy//sfmuLjKpzCduuRDTprEHmdj6vdBpDHSwmcJZ1SLeuA0Ad6elsB53gjy2bLMEKsJzyGBeiSyFN6J3Bdot5gDQv 2020-03-27T16:24:35.829 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-03-27T16:24:35.885 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-03-27T16:24:35.893 INFO:teuthology.task.internal:Saving configuration 2020-03-27T16:24:35.911 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-03-27T16:24:35.921 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-03-27T16:24:35.937 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-03-27 16:18:45.790990', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi023.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVhLNghyZBjiBOB8pt0T5QBqkNWXe3jKryAC5Lt+U7bc3XD4GlFM8sPegzve/KzS9jHkUYKftxsU/Q9raqEgM0=', u'description': u'/home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895547'} 2020-03-27T16:24:35.953 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-03-27 16:18:45.790971', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi156.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOygZcQJSR1l395N6jna8qTvo0AOe6SVmNEUaJHnlYmiWBD/xUTQ7hbDpW0/N6CkLtxYchygq+tPlVcZXN+3Eyo=', u'description': u'/home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895547'} 2020-03-27T16:24:35.984 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-03-27 16:18:45.791005', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi194.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPItOaXMY1tBO86ra8fqcQ+7CTUyBoKof8v8Rtl+ZCszQYjrLKjoVXQbsxRRUIT8w0+uVlB9S8dlPd5rQVkb4x4=', u'description': u'/home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895547'} 2020-03-27T16:24:35.984 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-03-27T16:24:35.993 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-03-27T16:24:35.993 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2020-03-27T16:24:35.994 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.c', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'client.2'] 2020-03-27T16:24:35.994 INFO:teuthology.run_tasks:Running task console_log... 2020-03-27T16:24:36.151 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-03-27T16:24:36.152 INFO:teuthology.run_tasks:Running task internal.connect... 2020-03-27T16:24:36.311 INFO:teuthology.task.internal:Opening connections... 2020-03-27T16:24:36.312 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi023.front.sepia.ceph.com 2020-03-27T16:24:36.313 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:36.420 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2020-03-27T16:24:36.421 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:36.523 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2020-03-27T16:24:36.524 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:36.626 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-03-27T16:24:36.633 INFO:teuthology.orchestra.run.smithi023:> uname -m 2020-03-27T16:24:36.743 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2020-03-27T16:24:36.744 INFO:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2020-03-27T16:24:36.807 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Linux" 2020-03-27T16:24:36.807 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="7 (Core)" 2020-03-27T16:24:36.807 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2020-03-27T16:24:36.808 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:36.808 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="7" 2020-03-27T16:24:36.808 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:36.808 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:36.808 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:36.808 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:36.809 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:36.809 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:24:36.809 INFO:teuthology.orchestra.run.smithi023.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:36.809 INFO:teuthology.orchestra.run.smithi023.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:36.809 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:36.809 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:36.810 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:24:36.810 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2020-03-27T16:24:36.826 INFO:teuthology.orchestra.run.smithi156:> uname -m 2020-03-27T16:24:36.945 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2020-03-27T16:24:36.945 INFO:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2020-03-27T16:24:37.029 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Linux" 2020-03-27T16:24:37.029 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="7 (Core)" 2020-03-27T16:24:37.029 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2020-03-27T16:24:37.029 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:37.029 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="7" 2020-03-27T16:24:37.029 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:37.030 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:37.030 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:37.030 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:37.030 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:37.030 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:24:37.030 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:37.030 INFO:teuthology.orchestra.run.smithi156.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:37.031 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:37.031 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:37.031 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:24:37.031 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2020-03-27T16:24:37.045 INFO:teuthology.orchestra.run.smithi194:> uname -m 2020-03-27T16:24:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2020-03-27T16:24:37.166 INFO:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2020-03-27T16:24:37.233 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Linux" 2020-03-27T16:24:37.233 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="7 (Core)" 2020-03-27T16:24:37.233 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2020-03-27T16:24:37.233 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:37.233 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="7" 2020-03-27T16:24:37.234 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:37.234 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:37.234 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:37.234 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:37.234 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:24:37.234 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:37.235 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:37.235 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:37.235 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:24:37.235 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2020-03-27T16:24:37.247 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-03-27T16:24:37.276 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-03-27T16:24:37.287 INFO:teuthology.task.internal:Checking for old test directory... 2020-03-27T16:24:37.287 INFO:teuthology.orchestra.run.smithi023:> test '!' -e /home/ubuntu/cephtest 2020-03-27T16:24:37.291 INFO:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2020-03-27T16:24:37.295 INFO:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2020-03-27T16:24:37.384 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-03-27T16:24:37.391 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-03-27T16:24:37.391 INFO:teuthology.orchestra.run.smithi023:> test -z $(ls -A /var/lib/ceph) 2020-03-27T16:24:37.395 INFO:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2020-03-27T16:24:37.398 INFO:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2020-03-27T16:24:37.494 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-03-27T16:24:37.545 INFO:teuthology.run_tasks:Running task kernel... 2020-03-27T16:24:37.559 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'osd.8': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'osd.11': {'sha1': 'distro', 'kdb': True}, 'osd.10': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.9': {'sha1': 'distro', 'kdb': True}, 'client.2': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2020-03-27T16:24:37.559 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-03-27T16:24:37.559 INFO:teuthology.orchestra.run.smithi023:> uname -r 2020-03-27T16:24:37.646 INFO:teuthology.orchestra.run.smithi023.stdout:3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:24:37.646 INFO:teuthology.task.kernel:Running kernel on smithi023: 3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:24:37.646 INFO:teuthology.orchestra.run.smithi023:> sudo yum install -y kernel 2020-03-27T16:24:38.503 INFO:teuthology.orchestra.run.smithi023.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2020-03-27T16:24:38.612 INFO:teuthology.orchestra.run.smithi023.stdout:Determining fastest mirrors 2020-03-27T16:24:39.103 INFO:teuthology.orchestra.run.smithi023.stdout: * base: mirror.umd.edu 2020-03-27T16:24:39.105 INFO:teuthology.orchestra.run.smithi023.stdout: * epel: download-cc-rdu01.fedoraproject.org 2020-03-27T16:24:39.106 INFO:teuthology.orchestra.run.smithi023.stdout: * extras: mirror.vcu.edu 2020-03-27T16:24:39.107 INFO:teuthology.orchestra.run.smithi023.stdout: * updates: mirror.siena.edu 2020-03-27T16:24:42.086 INFO:teuthology.orchestra.run.smithi023.stdout:Resolving Dependencies 2020-03-27T16:24:42.087 INFO:teuthology.orchestra.run.smithi023.stdout:--> Running transaction check 2020-03-27T16:24:42.087 INFO:teuthology.orchestra.run.smithi023.stdout:---> Package kernel.x86_64 0:3.10.0-1062.18.1.el7 will be installed 2020-03-27T16:24:43.359 INFO:teuthology.orchestra.run.smithi023.stdout:--> Finished Dependency Resolution 2020-03-27T16:24:44.192 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:24:44.192 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies Resolved 2020-03-27T16:24:44.213 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:24:44.213 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2020-03-27T16:24:44.213 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2020-03-27T16:24:44.214 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2020-03-27T16:24:44.214 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2020-03-27T16:24:44.214 INFO:teuthology.orchestra.run.smithi023.stdout: kernel x86_64 3.10.0-1062.18.1.el7 updates 50 M 2020-03-27T16:24:44.214 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:24:44.214 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2020-03-27T16:24:44.214 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2020-03-27T16:24:44.214 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2020-03-27T16:24:44.215 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:24:44.215 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 50 M 2020-03-27T16:24:44.215 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 64 M 2020-03-27T16:24:44.216 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading packages: 2020-03-27T16:24:44.224 INFO:teuthology.orchestra.run.smithi023.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2020-03-27T16:24:45.167 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2020-03-27T16:24:45.357 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2020-03-27T16:24:46.365 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded 2020-03-27T16:24:46.366 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2020-03-27T16:25:23.439 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:25:24.030 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:25:24.031 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:25:24.031 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2020-03-27T16:25:24.031 INFO:teuthology.orchestra.run.smithi023.stdout: kernel.x86_64 0:3.10.0-1062.18.1.el7 2020-03-27T16:25:24.031 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:25:24.031 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2020-03-27T16:25:24.083 INFO:teuthology.orchestra.run.smithi023:> rpm -q kernel --last | head -n 1 2020-03-27T16:25:24.407 INFO:teuthology.orchestra.run.smithi023.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:24:49 PM UTC 2020-03-27T16:25:24.410 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:25:24.410 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.12.1.el7.x86_64 Expected: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:25:24.410 INFO:teuthology.orchestra.run.smithi194:> uname -r 2020-03-27T16:25:24.511 INFO:teuthology.orchestra.run.smithi194.stdout:3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:25:24.512 INFO:teuthology.task.kernel:Running kernel on smithi194: 3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:25:24.512 INFO:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2020-03-27T16:25:25.440 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2020-03-27T16:25:25.542 INFO:teuthology.orchestra.run.smithi194.stdout:Determining fastest mirrors 2020-03-27T16:25:26.114 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.umd.edu 2020-03-27T16:25:26.147 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2020-03-27T16:25:26.148 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirror.vcu.edu 2020-03-27T16:25:26.148 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.siena.edu 2020-03-27T16:25:29.513 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2020-03-27T16:25:29.513 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2020-03-27T16:25:29.513 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package kernel.x86_64 0:3.10.0-1062.18.1.el7 will be installed 2020-03-27T16:25:30.792 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2020-03-27T16:25:31.682 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:25:31.682 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2020-03-27T16:25:31.683 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:25:31.683 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2020-03-27T16:25:31.683 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2020-03-27T16:25:31.684 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2020-03-27T16:25:31.684 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2020-03-27T16:25:31.684 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 3.10.0-1062.18.1.el7 updates 50 M 2020-03-27T16:25:31.684 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:25:31.684 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2020-03-27T16:25:31.684 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2020-03-27T16:25:31.685 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2020-03-27T16:25:31.685 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:25:31.685 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 50 M 2020-03-27T16:25:31.685 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 64 M 2020-03-27T16:25:31.686 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2020-03-27T16:25:31.693 INFO:teuthology.orchestra.run.smithi194.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2020-03-27T16:25:32.618 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2020-03-27T16:25:32.808 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2020-03-27T16:25:33.720 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2020-03-27T16:25:33.720 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2020-03-27T16:26:09.370 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:26:09.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:26:09.948 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:26:09.948 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2020-03-27T16:26:09.948 INFO:teuthology.orchestra.run.smithi194.stdout: kernel.x86_64 0:3.10.0-1062.18.1.el7 2020-03-27T16:26:09.948 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:26:09.948 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2020-03-27T16:26:09.999 INFO:teuthology.orchestra.run.smithi194:> rpm -q kernel --last | head -n 1 2020-03-27T16:26:10.395 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:25:36 PM UTC 2020-03-27T16:26:10.397 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:10.397 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.12.1.el7.x86_64 Expected: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:10.398 INFO:teuthology.orchestra.run.smithi156:> uname -r 2020-03-27T16:26:10.486 INFO:teuthology.orchestra.run.smithi156.stdout:3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:26:10.486 INFO:teuthology.task.kernel:Running kernel on smithi156: 3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:26:10.486 INFO:teuthology.orchestra.run.smithi156:> sudo yum install -y kernel 2020-03-27T16:26:11.345 INFO:teuthology.orchestra.run.smithi156.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2020-03-27T16:26:11.460 INFO:teuthology.orchestra.run.smithi156.stdout:Determining fastest mirrors 2020-03-27T16:26:11.804 INFO:teuthology.orchestra.run.smithi156.stdout: * base: mirror.umd.edu 2020-03-27T16:26:11.813 INFO:teuthology.orchestra.run.smithi156.stdout: * epel: ftp.linux.ncsu.edu 2020-03-27T16:26:11.814 INFO:teuthology.orchestra.run.smithi156.stdout: * extras: mirror.vcu.edu 2020-03-27T16:26:11.814 INFO:teuthology.orchestra.run.smithi156.stdout: * updates: mirror.siena.edu 2020-03-27T16:26:15.128 INFO:teuthology.orchestra.run.smithi156.stdout:Resolving Dependencies 2020-03-27T16:26:15.129 INFO:teuthology.orchestra.run.smithi156.stdout:--> Running transaction check 2020-03-27T16:26:15.129 INFO:teuthology.orchestra.run.smithi156.stdout:---> Package kernel.x86_64 0:3.10.0-1062.18.1.el7 will be installed 2020-03-27T16:26:16.432 INFO:teuthology.orchestra.run.smithi156.stdout:--> Finished Dependency Resolution 2020-03-27T16:26:17.236 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:26:17.237 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies Resolved 2020-03-27T16:26:17.246 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:26:17.246 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2020-03-27T16:26:17.247 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2020-03-27T16:26:17.247 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2020-03-27T16:26:17.247 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2020-03-27T16:26:17.247 INFO:teuthology.orchestra.run.smithi156.stdout: kernel x86_64 3.10.0-1062.18.1.el7 updates 50 M 2020-03-27T16:26:17.247 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:26:17.247 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2020-03-27T16:26:17.247 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2020-03-27T16:26:17.248 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2020-03-27T16:26:17.248 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:26:17.248 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 50 M 2020-03-27T16:26:17.248 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 64 M 2020-03-27T16:26:17.248 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packages: 2020-03-27T16:26:17.261 INFO:teuthology.orchestra.run.smithi156.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2020-03-27T16:26:18.177 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2020-03-27T16:26:18.358 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2020-03-27T16:26:19.283 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded 2020-03-27T16:26:19.283 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2020-03-27T16:26:54.389 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:26:54.972 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:26:54.973 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:26:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2020-03-27T16:26:54.973 INFO:teuthology.orchestra.run.smithi156.stdout: kernel.x86_64 0:3.10.0-1062.18.1.el7 2020-03-27T16:26:54.973 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:26:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2020-03-27T16:26:55.022 INFO:teuthology.orchestra.run.smithi156:> rpm -q kernel --last | head -n 1 2020-03-27T16:26:55.405 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:26:22 PM UTC 2020-03-27T16:26:55.407 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:55.408 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.12.1.el7.x86_64 Expected: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:55.408 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-03-27T16:26:55.408 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-03-27T16:26:55.408 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-03-27T16:26:55.408 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-03-27T16:26:55.408 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-03-27T16:26:55.408 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi023.front.sepia.ceph.com, path=None, version=distro) 2020-03-27T16:26:55.409 INFO:teuthology.orchestra.run.smithi023:> rpm -q kernel --last | head -n 1 2020-03-27T16:26:55.780 INFO:teuthology.orchestra.run.smithi023.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:24:49 PM UTC 2020-03-27T16:26:55.782 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:55.782 INFO:teuthology.orchestra.run.smithi023:> sudo rpm -qi grub2-tools 2020-03-27T16:26:55.955 INFO:teuthology.orchestra.run.smithi023.stdout:Name : grub2-tools 2020-03-27T16:26:55.956 INFO:teuthology.orchestra.run.smithi023.stdout:Epoch : 1 2020-03-27T16:26:55.956 INFO:teuthology.orchestra.run.smithi023.stdout:Version : 2.02 2020-03-27T16:26:55.956 INFO:teuthology.orchestra.run.smithi023.stdout:Release : 0.76.el7.centos 2020-03-27T16:26:55.956 INFO:teuthology.orchestra.run.smithi023.stdout:Architecture: x86_64 2020-03-27T16:26:55.956 INFO:teuthology.orchestra.run.smithi023.stdout:Install Date: Tue 11 Feb 2020 03:34:40 PM UTC 2020-03-27T16:26:55.956 INFO:teuthology.orchestra.run.smithi023.stdout:Group : System Environment/Base 2020-03-27T16:26:55.957 INFO:teuthology.orchestra.run.smithi023.stdout:Size : 10080361 2020-03-27T16:26:55.957 INFO:teuthology.orchestra.run.smithi023.stdout:License : GPLv3+ 2020-03-27T16:26:55.957 INFO:teuthology.orchestra.run.smithi023.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2020-03-27T16:26:55.957 INFO:teuthology.orchestra.run.smithi023.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2020-03-27T16:26:55.957 INFO:teuthology.orchestra.run.smithi023.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2020-03-27T16:26:55.957 INFO:teuthology.orchestra.run.smithi023.stdout:Build Host : kbuilder.bsys.centos.org 2020-03-27T16:26:55.958 INFO:teuthology.orchestra.run.smithi023.stdout:Relocations : (not relocatable) 2020-03-27T16:26:55.958 INFO:teuthology.orchestra.run.smithi023.stdout:Packager : CentOS BuildSystem 2020-03-27T16:26:55.958 INFO:teuthology.orchestra.run.smithi023.stdout:Vendor : CentOS 2020-03-27T16:26:55.958 INFO:teuthology.orchestra.run.smithi023.stdout:URL : http://www.gnu.org/software/grub/ 2020-03-27T16:26:55.958 INFO:teuthology.orchestra.run.smithi023.stdout:Summary : Support tools for GRUB. 2020-03-27T16:26:55.958 INFO:teuthology.orchestra.run.smithi023.stdout:Description : 2020-03-27T16:26:55.958 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:26:55.959 INFO:teuthology.orchestra.run.smithi023.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-03-27T16:26:55.959 INFO:teuthology.orchestra.run.smithi023.stdout:customizable bootloader with modular architecture. It supports a rich 2020-03-27T16:26:55.959 INFO:teuthology.orchestra.run.smithi023.stdout:variety of kernel formats, file systems, computer architectures and 2020-03-27T16:26:55.959 INFO:teuthology.orchestra.run.smithi023.stdout:hardware devices. 2020-03-27T16:26:55.959 INFO:teuthology.orchestra.run.smithi023.stdout: 2020-03-27T16:26:55.959 INFO:teuthology.orchestra.run.smithi023.stdout:This subpackage provides tools for support of all platforms. 2020-03-27T16:26:55.960 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-03-27T16:26:55.961 INFO:teuthology.task.kernel:Updating grub on smithi023 to boot 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:55.961 INFO:teuthology.orchestra.run.smithi023:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-03-27T16:26:56.443 INFO:teuthology.orchestra.run.smithi023.stderr:Generating grub configuration file ... 2020-03-27T16:26:56.572 INFO:teuthology.orchestra.run.smithi023.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:56.589 INFO:teuthology.orchestra.run.smithi023.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.18.1.el7.x86_64.img 2020-03-27T16:26:56.856 INFO:teuthology.orchestra.run.smithi023.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:26:56.880 INFO:teuthology.orchestra.run.smithi023.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.12.1.el7.x86_64.img 2020-03-27T16:26:56.920 INFO:teuthology.orchestra.run.smithi023.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2020-03-27T16:26:56.939 INFO:teuthology.orchestra.run.smithi023.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2020-03-27T16:26:56.971 INFO:teuthology.orchestra.run.smithi023.stderr:Found linux image: /boot/vmlinuz-0-rescue-11867a3080154962a87601c586b1198d 2020-03-27T16:26:56.982 INFO:teuthology.orchestra.run.smithi023.stderr:Found initrd image: /boot/initramfs-0-rescue-11867a3080154962a87601c586b1198d.img 2020-03-27T16:26:57.979 INFO:teuthology.orchestra.run.smithi023.stderr:done 2020-03-27T16:26:57.981 INFO:teuthology.orchestra.run.smithi023:> mktemp 2020-03-27T16:26:58.057 INFO:teuthology.orchestra.run.smithi023.stdout:/tmp/tmp.WxsT9EHePY 2020-03-27T16:26:58.058 INFO:teuthology.orchestra.run.smithi023:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WxsT9EHePY 2020-03-27T16:26:58.164 INFO:teuthology.orchestra.run.smithi023:> sudo chmod 0666 /tmp/tmp.WxsT9EHePY 2020-03-27T16:26:58.358 DEBUG:teuthology.orchestra.remote:smithi023:/tmp/tmp.WxsT9EHePY is 6KB 2020-03-27T16:26:58.456 INFO:teuthology.orchestra.run.smithi023:> rm -fr /tmp/tmp.WxsT9EHePY 2020-03-27T16:26:58.542 INFO:teuthology.orchestra.run.smithi023:> sudo grub2-set-default 0 2020-03-27T16:26:58.729 INFO:teuthology.orchestra.run.smithi023:> sudo shutdown -r now 2020-03-27T16:26:58.732 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2020-03-27T16:26:58.732 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2020-03-27T16:26:58.733 INFO:teuthology.orchestra.run.smithi194:> rpm -q kernel --last | head -n 1 2020-03-27T16:26:59.098 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:25:36 PM UTC 2020-03-27T16:26:59.099 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:59.100 INFO:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2020-03-27T16:26:59.248 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2020-03-27T16:26:59.249 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2020-03-27T16:26:59.249 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.02 2020-03-27T16:26:59.249 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 0.76.el7.centos 2020-03-27T16:26:59.249 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2020-03-27T16:26:59.249 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Tue 11 Feb 2020 03:34:40 PM UTC 2020-03-27T16:26:59.249 INFO:teuthology.orchestra.run.smithi194.stdout:Group : System Environment/Base 2020-03-27T16:26:59.249 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 10080361 2020-03-27T16:26:59.250 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2020-03-27T16:26:59.250 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2020-03-27T16:26:59.250 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2020-03-27T16:26:59.250 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2020-03-27T16:26:59.251 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : kbuilder.bsys.centos.org 2020-03-27T16:26:59.251 INFO:teuthology.orchestra.run.smithi194.stdout:Relocations : (not relocatable) 2020-03-27T16:26:59.251 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : CentOS BuildSystem 2020-03-27T16:26:59.251 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2020-03-27T16:26:59.251 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2020-03-27T16:26:59.252 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2020-03-27T16:26:59.252 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2020-03-27T16:26:59.252 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:26:59.252 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-03-27T16:26:59.252 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2020-03-27T16:26:59.252 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2020-03-27T16:26:59.252 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2020-03-27T16:26:59.253 INFO:teuthology.orchestra.run.smithi194.stdout: 2020-03-27T16:26:59.253 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2020-03-27T16:26:59.254 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-03-27T16:26:59.254 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:59.254 INFO:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-03-27T16:26:59.719 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2020-03-27T16:26:59.846 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:59.861 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.18.1.el7.x86_64.img 2020-03-27T16:27:00.128 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:27:00.156 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.12.1.el7.x86_64.img 2020-03-27T16:27:00.191 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2020-03-27T16:27:00.212 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2020-03-27T16:27:00.241 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-0-rescue-11867a3080154962a87601c586b1198d 2020-03-27T16:27:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initramfs-0-rescue-11867a3080154962a87601c586b1198d.img 2020-03-27T16:27:01.164 INFO:teuthology.orchestra.run.smithi194.stderr:done 2020-03-27T16:27:01.166 INFO:teuthology.orchestra.run.smithi194:> mktemp 2020-03-27T16:27:01.226 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.XLG5N0kW5t 2020-03-27T16:27:01.226 INFO:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XLG5N0kW5t 2020-03-27T16:27:01.292 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.XLG5N0kW5t 2020-03-27T16:27:01.419 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.XLG5N0kW5t is 6KB 2020-03-27T16:27:01.470 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.XLG5N0kW5t 2020-03-27T16:27:01.514 INFO:teuthology.orchestra.run.smithi194:> sudo grub2-set-default 0 2020-03-27T16:27:01.770 INFO:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2020-03-27T16:27:01.773 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-03-27T16:27:01.774 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=None, version=distro) 2020-03-27T16:27:01.774 INFO:teuthology.orchestra.run.smithi156:> rpm -q kernel --last | head -n 1 2020-03-27T16:27:02.137 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:26:22 PM UTC 2020-03-27T16:27:02.139 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:27:02.140 INFO:teuthology.orchestra.run.smithi156:> sudo rpm -qi grub2-tools 2020-03-27T16:27:02.283 INFO:teuthology.orchestra.run.smithi156.stdout:Name : grub2-tools 2020-03-27T16:27:02.283 INFO:teuthology.orchestra.run.smithi156.stdout:Epoch : 1 2020-03-27T16:27:02.283 INFO:teuthology.orchestra.run.smithi156.stdout:Version : 2.02 2020-03-27T16:27:02.284 INFO:teuthology.orchestra.run.smithi156.stdout:Release : 0.76.el7.centos 2020-03-27T16:27:02.284 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: x86_64 2020-03-27T16:27:02.284 INFO:teuthology.orchestra.run.smithi156.stdout:Install Date: Tue 11 Feb 2020 03:34:40 PM UTC 2020-03-27T16:27:02.284 INFO:teuthology.orchestra.run.smithi156.stdout:Group : System Environment/Base 2020-03-27T16:27:02.284 INFO:teuthology.orchestra.run.smithi156.stdout:Size : 10080361 2020-03-27T16:27:02.284 INFO:teuthology.orchestra.run.smithi156.stdout:License : GPLv3+ 2020-03-27T16:27:02.284 INFO:teuthology.orchestra.run.smithi156.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2020-03-27T16:27:02.285 INFO:teuthology.orchestra.run.smithi156.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2020-03-27T16:27:02.285 INFO:teuthology.orchestra.run.smithi156.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2020-03-27T16:27:02.285 INFO:teuthology.orchestra.run.smithi156.stdout:Build Host : kbuilder.bsys.centos.org 2020-03-27T16:27:02.285 INFO:teuthology.orchestra.run.smithi156.stdout:Relocations : (not relocatable) 2020-03-27T16:27:02.285 INFO:teuthology.orchestra.run.smithi156.stdout:Packager : CentOS BuildSystem 2020-03-27T16:27:02.285 INFO:teuthology.orchestra.run.smithi156.stdout:Vendor : CentOS 2020-03-27T16:27:02.285 INFO:teuthology.orchestra.run.smithi156.stdout:URL : http://www.gnu.org/software/grub/ 2020-03-27T16:27:02.286 INFO:teuthology.orchestra.run.smithi156.stdout:Summary : Support tools for GRUB. 2020-03-27T16:27:02.286 INFO:teuthology.orchestra.run.smithi156.stdout:Description : 2020-03-27T16:27:02.286 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:27:02.286 INFO:teuthology.orchestra.run.smithi156.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-03-27T16:27:02.286 INFO:teuthology.orchestra.run.smithi156.stdout:customizable bootloader with modular architecture. It supports a rich 2020-03-27T16:27:02.286 INFO:teuthology.orchestra.run.smithi156.stdout:variety of kernel formats, file systems, computer architectures and 2020-03-27T16:27:02.287 INFO:teuthology.orchestra.run.smithi156.stdout:hardware devices. 2020-03-27T16:27:02.287 INFO:teuthology.orchestra.run.smithi156.stdout: 2020-03-27T16:27:02.287 INFO:teuthology.orchestra.run.smithi156.stdout:This subpackage provides tools for support of all platforms. 2020-03-27T16:27:02.288 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-03-27T16:27:02.288 INFO:teuthology.task.kernel:Updating grub on smithi156 to boot 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:27:02.288 INFO:teuthology.orchestra.run.smithi156:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-03-27T16:27:02.743 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2020-03-27T16:27:02.895 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:27:02.911 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.18.1.el7.x86_64.img 2020-03-27T16:27:03.163 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:27:03.185 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.12.1.el7.x86_64.img 2020-03-27T16:27:03.215 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2020-03-27T16:27:03.233 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2020-03-27T16:27:03.259 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-0-rescue-11867a3080154962a87601c586b1198d 2020-03-27T16:27:03.268 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initramfs-0-rescue-11867a3080154962a87601c586b1198d.img 2020-03-27T16:27:04.215 INFO:teuthology.orchestra.run.smithi156.stderr:done 2020-03-27T16:27:04.218 INFO:teuthology.orchestra.run.smithi156:> mktemp 2020-03-27T16:27:04.283 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.1lIVmWRnbm 2020-03-27T16:27:04.284 INFO:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1lIVmWRnbm 2020-03-27T16:27:04.359 INFO:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.1lIVmWRnbm 2020-03-27T16:27:04.483 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.1lIVmWRnbm is 6KB 2020-03-27T16:27:04.535 INFO:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.1lIVmWRnbm 2020-03-27T16:27:04.583 INFO:teuthology.orchestra.run.smithi156:> sudo grub2-set-default 0 2020-03-27T16:27:04.822 INFO:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2020-03-27T16:27:34.853 INFO:teuthology.misc:Re-opening connections... 2020-03-27T16:27:34.853 INFO:teuthology.misc:trying to connect to ubuntu@smithi023.front.sepia.ceph.com 2020-03-27T16:27:34.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:27:34.854 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi023.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:27:53.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2020-03-27T16:27:53.173 INFO:teuthology.misc:trying to connect to ubuntu@smithi156.front.sepia.ceph.com 2020-03-27T16:27:53.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:27:53.174 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi156.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:28:11.477 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-03-27T16:28:11.478 DEBUG:teuthology.task.console_log:Killing console logger for smithi194 2020-03-27T16:28:11.478 DEBUG:teuthology.task.console_log:Killing console logger for smithi023 2020-03-27T16:28:11.478 DEBUG:teuthology.task.console_log:Killing console logger for smithi156 2020-03-27T16:28:11.479 DEBUG:teuthology.task.console_log:Killing console logger for smithi194 2020-03-27T16:28:11.479 DEBUG:teuthology.task.console_log:Killing console logger for smithi023 2020-03-27T16:28:11.479 DEBUG:teuthology.task.console_log:Killing console logger for smithi156 2020-03-27T16:28:11.479 DEBUG:teuthology.exit:Finished running handlers