2020-03-27T16:00:44.427 INFO:root:teuthology version: 1.0.0-b3a6b1a 2020-03-27T16:00:44.428 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.W52PHD.tmp -- --verbose --lock --description rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} --name sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895545 2020-03-27T16:00:44.464 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-03-27T16:00:44.517 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895545 branch: revert-dec description: rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} email: null first_in_suite: false job_id: '4895545' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'librbd C and C++ api tests ' name: sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - volumes: count: 4 size: 10 os_type: centos os_version: '7.6' overrides: admin_socket: branch: revert-dec ceph: conf: global: mon client directed command retry: 5 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd backoff on peering: true osd debug verify cached snaps: true osd debug verify missing on start: true osd map cache size: 1 osd max backfills: 6 osd max markdown count: 1000 osd op queue: debug_random osd op queue cut off: debug_random osd scrub during recovery: false osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - osd_map_cache_size - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request mon_bind_msgr2: false sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: min_in: 4 workunit: branch: revert-dec sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c owner: scheduled_sage@teuthology priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - - mon.c - osd.8 - osd.9 - osd.10 - osd.11 - client.2 sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c suite: rados:thrash-old-clients suite_branch: revert-dec suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_revert-dec/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c tasks: - install: branch: nautilus exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs - cephadm: null - thrashosds: chance_pgnum_grow: 0.25 chance_pgpnum_fix: 0.25 chance_test_map_discontinuity: 2 timeout: 1800 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.14496 workload: - workunit: clients: client.2: - rbd/test_librbd.sh 2020-03-27T16:00:44.517 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_revert-dec/qa; will attempt to use it 2020-03-27T16:00:44.518 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_revert-dec/qa/tasks 2020-03-27T16:00:44.518 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-03-27T16:00:44.520 INFO:teuthology.task.internal:Checking packages... 2020-03-27T16:00:44.532 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '04af5888e1368740ebb4403bab567f8cfd92df6c' 2020-03-27T16:00:44.533 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-03-27T16:00:44.533 INFO:teuthology.packaging:ref: None 2020-03-27T16:00:44.533 INFO:teuthology.packaging:tag: None 2020-03-27T16:00:44.533 INFO:teuthology.packaging:branch: revert-dec 2020-03-27T16:00:44.533 INFO:teuthology.packaging:sha1: 04af5888e1368740ebb4403bab567f8cfd92df6c 2020-03-27T16:00:44.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=revert-dec 2020-03-27T16:00:44.757 INFO:teuthology.task.internal:Found packages for ceph version 15.2.0-377.g04af588 2020-03-27T16:00:44.758 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-03-27T16:00:44.766 INFO:teuthology.task.internal:no buildpackages task found 2020-03-27T16:00:44.766 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-03-27T16:00:44.854 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-03-27T16:00:44.854 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-03-27T16:00:44.912 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:00:54.931 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:04.949 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:14.968 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:24.979 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:34.989 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:45.005 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:01:55.023 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:05.042 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:15.053 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:25.066 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:35.076 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:45.093 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:02:55.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:05.121 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:15.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:25.160 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:35.175 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:45.193 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:03:55.213 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:05.230 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:15.245 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:25.261 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:35.279 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:45.298 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:04:55.312 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:05.329 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:15.343 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:25.361 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:35.374 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:45.387 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:05:55.405 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:05.421 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:15.439 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:25.459 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:35.474 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:45.491 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:06:55.506 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:05.531 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:15.549 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:25.565 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:35.581 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:45.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:07:55.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:05.633 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:15.648 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:25.668 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:35.679 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:45.691 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:08:55.705 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:05.723 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:15.739 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:25.757 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:35.773 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:45.793 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:09:55.810 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:05.827 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:15.842 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:25.860 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:35.880 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:45.893 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:10:55.905 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:05.920 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:15.973 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:25.992 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:36.011 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:46.027 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:11:56.044 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:06.061 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:16.079 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:26.090 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:36.107 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:46.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:12:56.145 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:06.157 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:16.175 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:26.204 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:36.221 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:46.239 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:13:56.259 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:06.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:16.291 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:26.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:36.324 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:46.343 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:14:56.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:06.375 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:16.389 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:26.406 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:36.424 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:46.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:15:56.458 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:06.474 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:16.492 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:26.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:36.524 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:46.543 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:16:56.557 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:06.573 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:16.585 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:26.601 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:36.619 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:46.637 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:17:56.656 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:06.673 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:16.691 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:26.711 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:36.727 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-03-27T16:18:46.744 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895545', 'machine_type': 'smithi'} 2020-03-27T16:18:46.761 DEBUG:teuthology.lock.ops:locked ubuntu@smithi097.front.sepia.ceph.com, ubuntu@smithi107.front.sepia.ceph.com, ubuntu@smithi189.front.sepia.ceph.com 2020-03-27T16:18:46.834 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-03-27T16:18:47.022 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 7.6 2020-03-27T16:18:47.025 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 7.6 2020-03-27T16:18:47.027 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 7.6 2020-03-27T16:18:47.336 INFO:teuthology.orchestra.console:Power off smithi107 2020-03-27T16:18:47.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-03-27T16:18:47.350 INFO:teuthology.orchestra.console:Power off smithi189 2020-03-27T16:18:47.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-03-27T16:18:47.364 INFO:teuthology.orchestra.console:Power off smithi097 2020-03-27T16:18:47.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-03-27T16:18:47.370 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:47.378 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:47.386 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:51.395 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:51.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:51.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:55.510 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:55.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:55.525 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:55.719 INFO:teuthology.orchestra.console:Power off for smithi189 completed 2020-03-27T16:18:55.821 INFO:teuthology.orchestra.console:Power on smithi189 2020-03-27T16:18:55.821 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-03-27T16:18:55.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:59.627 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:59.635 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:59.837 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2020-03-27T16:18:59.844 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2020-03-27T16:18:59.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:59.938 INFO:teuthology.orchestra.console:Power on smithi107 2020-03-27T16:18:59.939 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-03-27T16:18:59.946 INFO:teuthology.orchestra.console:Power on smithi097 2020-03-27T16:18:59.946 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-03-27T16:18:59.957 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:18:59.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:19:03.978 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:19:03.985 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:19:03.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:19:04.194 INFO:teuthology.orchestra.console:Power on for smithi189 completed 2020-03-27T16:19:04.200 INFO:teuthology.orchestra.console:Power on for smithi097 completed 2020-03-27T16:19:04.295 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish 2020-03-27T16:19:04.300 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2020-03-27T16:19:08.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-03-27T16:19:08.305 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2020-03-27T16:19:08.405 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2020-03-27T16:21:50.302 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:21:50.316 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:21:59.370 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:21:59.401 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:08.428 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:08.454 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:09.401 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:17.517 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:17.519 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:18.470 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:26.601 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:26.602 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:27.526 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:35.657 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:35.658 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:36.582 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:44.714 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:44.715 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:45.637 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:53.770 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:53.772 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:22:54.698 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:02.825 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:03.750 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:11.881 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:12.806 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:21.863 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:31.149 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:31.371 INFO:teuthology.orchestra.run.smithi189:> hostname 2020-03-27T16:23:31.819 INFO:teuthology.orchestra.run.smithi189.stdout:smithi125 2020-03-27T16:23:31.819 INFO:teuthology.orchestra.run.smithi189:> grep smithi125 /etc/hosts 2020-03-27T16:23:31.865 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2020-03-27T16:23:31.865 INFO:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2020-03-27T16:23:31.956 INFO:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi125/smithi189/g' /etc/hosts 2020-03-27T16:23:32.018 INFO:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/172.21.15.125/172.21.15.189/g' /etc/hosts 2020-03-27T16:23:32.079 INFO:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi125/smithi189/g' /etc/hostname 2020-03-27T16:23:32.141 INFO:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2020-03-27T16:23:32.195 INFO:teuthology.provision.fog.smithi189:Deploy complete! 2020-03-27T16:23:32.197 DEBUG:teuthology.parallel:result is None 2020-03-27T16:23:49.321 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:49.581 INFO:teuthology.orchestra.run.smithi097:> hostname 2020-03-27T16:23:49.992 INFO:teuthology.orchestra.run.smithi097.stdout:smithi125 2020-03-27T16:23:49.992 INFO:teuthology.orchestra.run.smithi097:> grep smithi125 /etc/hosts 2020-03-27T16:23:50.033 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2020-03-27T16:23:50.033 INFO:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2020-03-27T16:23:50.183 INFO:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi125/smithi097/g' /etc/hosts 2020-03-27T16:23:50.238 INFO:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.125/172.21.15.97/g' /etc/hosts 2020-03-27T16:23:50.293 INFO:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi125/smithi097/g' /etc/hostname 2020-03-27T16:23:50.344 INFO:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2020-03-27T16:23:50.397 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2020-03-27T16:23:50.399 DEBUG:teuthology.parallel:result is None 2020-03-27T16:23:59.307 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:23:59.557 INFO:teuthology.orchestra.run.smithi107:> hostname 2020-03-27T16:24:00.016 INFO:teuthology.orchestra.run.smithi107.stdout:smithi125 2020-03-27T16:24:00.017 INFO:teuthology.orchestra.run.smithi107:> grep smithi125 /etc/hosts 2020-03-27T16:24:00.073 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2020-03-27T16:24:00.073 INFO:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2020-03-27T16:24:00.176 INFO:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi125/smithi107/g' /etc/hosts 2020-03-27T16:24:00.237 INFO:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.125/172.21.15.107/g' /etc/hosts 2020-03-27T16:24:00.297 INFO:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi125/smithi107/g' /etc/hostname 2020-03-27T16:24:00.351 INFO:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2020-03-27T16:24:00.403 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2020-03-27T16:24:00.405 DEBUG:teuthology.parallel:result is None 2020-03-27T16:24:00.642 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2020-03-27T16:24:00.643 INFO:teuthology.lock.ops:New key found. Updating... 2020-03-27T16:24:00.661 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2020-03-27T16:24:00.661 INFO:teuthology.lock.ops:New key found. Updating... 2020-03-27T16:24:00.685 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com 2020-03-27T16:24:00.685 INFO:teuthology.lock.ops:New key found. Updating... 2020-03-27T16:24:00.700 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2020-03-27T16:24:00.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:24:00.701 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:00.796 INFO:teuthology.orchestra.run.smithi097:> true 2020-03-27T16:24:01.169 INFO:teuthology.orchestra.run.smithi097:> uname -m 2020-03-27T16:24:01.246 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2020-03-27T16:24:01.247 INFO:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2020-03-27T16:24:01.312 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Linux" 2020-03-27T16:24:01.312 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="7 (Core)" 2020-03-27T16:24:01.312 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2020-03-27T16:24:01.312 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:01.312 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="7" 2020-03-27T16:24:01.313 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:01.313 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:01.313 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:01.313 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:01.313 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:01.313 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:24:01.313 INFO:teuthology.orchestra.run.smithi097.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:01.313 INFO:teuthology.orchestra.run.smithi097.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:01.314 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:01.314 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:01.314 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:24:01.315 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2020-03-27T16:24:01.332 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2020-03-27T16:24:01.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:24:01.332 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:01.401 INFO:teuthology.orchestra.run.smithi107:> true 2020-03-27T16:24:01.671 INFO:teuthology.orchestra.run.smithi107:> uname -m 2020-03-27T16:24:01.713 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2020-03-27T16:24:01.713 INFO:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2020-03-27T16:24:01.756 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Linux" 2020-03-27T16:24:01.756 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="7 (Core)" 2020-03-27T16:24:01.756 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2020-03-27T16:24:01.756 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:01.757 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="7" 2020-03-27T16:24:01.757 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:01.757 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:01.757 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:01.757 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:01.757 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:01.757 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:24:01.758 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:01.759 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:01.759 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:01.760 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:01.760 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:24:01.760 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2020-03-27T16:24:01.776 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server 2020-03-27T16:24:01.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:24:01.777 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:01.886 INFO:teuthology.orchestra.run.smithi189:> true 2020-03-27T16:24:02.257 INFO:teuthology.orchestra.run.smithi189:> uname -m 2020-03-27T16:24:02.337 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2020-03-27T16:24:02.337 INFO:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2020-03-27T16:24:02.405 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Linux" 2020-03-27T16:24:02.405 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="7 (Core)" 2020-03-27T16:24:02.405 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2020-03-27T16:24:02.406 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:02.406 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="7" 2020-03-27T16:24:02.406 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:02.406 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:02.406 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:02.406 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:02.406 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:02.407 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:02.407 INFO:teuthology.orchestra.run.smithi189.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:02.407 INFO:teuthology.orchestra.run.smithi189.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:02.407 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:02.407 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:02.407 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:02.408 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2020-03-27T16:24:02.431 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-03-27T16:24:02.478 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi097.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDy7ayplmPHTWJvsSiJmhq+UgHe+2rbILp5xqswkd92NX+rLENPAOaibMbUbLmI3MSBtiHcwDBjoNNounZkAhmOC4vi6BOlx4cX4ZZIA5ahDRpchsheoMjDuSZcfG6yMELiJvD7ABo5XrOlQQI/m+l7/wlb4w1TmL+LRiCBz+KgjeqsgQM4MaktPQ3k0Xe7wtbWV5/2QYploeqYHLrMbVKygW1ce80/5Leahdha2gpAMCaQBAjtsNY9HAZTL24mhAGtQkCScPblQ6dDzRTtpBqSNbqYnA2u0SmuFncYl+7EJKFuqT+MZrZUzXNvOhINhbKmJzIRBEBa2tHvWozpu1F smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9OUyuXBepTPcMl9O1rjYeClPdHC92aIxMx4a9iiZ2aFFk+HQrVr2y4DKVO0cKpYAZ9n9wxYgKFH+LDjbkfq73v54mbgDGqFQLljhJY/qnGOr8lpnWTfcy4zXbX0iEIEUtYLp7jfz+zudZpeq7xJnsV6Zl0G6jOla6fy6Cb4nN4Cr+aU0ipDLQC1FKGJDvs5As2tzlXTqNSZIX+ZJXei/umtS/h+k7G43giu8l4vBEw3gQ7S/bITicDSuEmWy4X9gaYzL2kAUJqDlLh9vUqGEobTZ4inCWE9P2PiBJ/zfcd76RUlQJOiaWPU4GygkRIptznkykLg0SnS3WQ6SlMkuz smithi189.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNQ4x9hCGZuhDIy/ut8ZtucdM7nnpiGoVl2tMWgzlbVcS8Elio6NVZPgVc9Q8VXFDmd1pDzFGWjXqIkfpiMCLqOaMzvwK5lW/2uThozxYmXlRJxcQA51u5llq7ZaoRvFj0fKLhQf/IbmvlAgY1Ysd+4Hin0bS/fG7gInKT9sKSLVnTHxS2n/NB5NuF2NEjXtlkkfe4HGSUWW4epQLVbFMGH8j2S9eyks4vMFUZ4BCMPFOk2XUj6iWqRC6XSpcYB6OUNx/ZgPT20KN8vXGwzk0SrXrxLAWLp8z1wPzVnYNtzR0NmzZ+P+AhppqNPCJksFxs9+eI5Edl+ftYNTAIvRzv 2020-03-27T16:24:02.478 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-03-27T16:24:02.541 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-03-27T16:24:02.546 INFO:teuthology.task.internal:Saving configuration 2020-03-27T16:24:02.562 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-03-27T16:24:02.570 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-03-27T16:24:02.586 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-03-27 16:18:46.741089', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi097.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFWNcHJ3rJcQyXjhfAxgpy+G2qfvO5vBHJbOczXjge080e7fLiPCmRO015+HLKXBaRogxEYToypPtOUTah64Xx8=', u'description': u'/home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895545'} 2020-03-27T16:24:02.600 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-03-27 16:18:46.741104', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi107.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFj/hl1SWL7WtzDuHRfTxWR+jQ2T5kGm48D6pV4UAoqT3rmTCGmsnqvNqJ9i5A/MGn9rM3a2dqNpFt29AFmparQ=', u'description': u'/home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895545'} 2020-03-27T16:24:02.615 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-03-27 16:18:46.741069', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi189.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmA/bpJdnIKhsdK2FCjODGshMyIqIleJ8nUe2wJtSoEhXCD/9FQmV+J4JpHaSLZN1jUnTeOLy8ZK/x1gkxeaKo=', u'description': u'/home/teuthworker/archive/sage-2020-03-27_15:59:34-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895545'} 2020-03-27T16:24:02.616 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-03-27T16:24:02.623 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-03-27T16:24:02.624 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2020-03-27T16:24:02.624 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.c', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'client.2'] 2020-03-27T16:24:02.624 INFO:teuthology.run_tasks:Running task console_log... 2020-03-27T16:24:02.748 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-03-27T16:24:02.749 INFO:teuthology.run_tasks:Running task internal.connect... 2020-03-27T16:24:02.754 INFO:teuthology.task.internal:Opening connections... 2020-03-27T16:24:02.755 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2020-03-27T16:24:02.756 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:02.863 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2020-03-27T16:24:02.863 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:02.965 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2020-03-27T16:24:02.966 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:24:03.035 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-03-27T16:24:03.043 INFO:teuthology.orchestra.run.smithi189:> uname -m 2020-03-27T16:24:03.204 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2020-03-27T16:24:03.205 INFO:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2020-03-27T16:24:03.265 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Linux" 2020-03-27T16:24:03.265 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="7 (Core)" 2020-03-27T16:24:03.265 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2020-03-27T16:24:03.265 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:03.265 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="7" 2020-03-27T16:24:03.265 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:03.265 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:03.266 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:03.266 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:03.266 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:03.266 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:03.266 INFO:teuthology.orchestra.run.smithi189.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:03.266 INFO:teuthology.orchestra.run.smithi189.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:03.266 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:03.267 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:03.267 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:03.267 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2020-03-27T16:24:03.280 INFO:teuthology.orchestra.run.smithi097:> uname -m 2020-03-27T16:24:03.403 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2020-03-27T16:24:03.404 INFO:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2020-03-27T16:24:03.476 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Linux" 2020-03-27T16:24:03.476 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="7 (Core)" 2020-03-27T16:24:03.476 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2020-03-27T16:24:03.476 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:03.477 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="7" 2020-03-27T16:24:03.477 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:03.477 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:03.477 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:03.477 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:03.477 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:03.478 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:24:03.478 INFO:teuthology.orchestra.run.smithi097.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:03.478 INFO:teuthology.orchestra.run.smithi097.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:03.478 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:03.478 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:03.478 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:24:03.479 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2020-03-27T16:24:03.492 INFO:teuthology.orchestra.run.smithi107:> uname -m 2020-03-27T16:24:03.554 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2020-03-27T16:24:03.555 INFO:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2020-03-27T16:24:03.595 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Linux" 2020-03-27T16:24:03.596 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="7 (Core)" 2020-03-27T16:24:03.596 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2020-03-27T16:24:03.596 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2020-03-27T16:24:03.596 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="7" 2020-03-27T16:24:03.596 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2020-03-27T16:24:03.596 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2020-03-27T16:24:03.596 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2020-03-27T16:24:03.597 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.centos.org/" 2020-03-27T16:24:03.597 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-03-27T16:24:03.597 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:24:03.597 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2020-03-27T16:24:03.597 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2020-03-27T16:24:03.597 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-03-27T16:24:03.597 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2020-03-27T16:24:03.598 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:24:03.598 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2020-03-27T16:24:03.610 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-03-27T16:24:03.642 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-03-27T16:24:03.651 INFO:teuthology.task.internal:Checking for old test directory... 2020-03-27T16:24:03.651 INFO:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2020-03-27T16:24:03.655 INFO:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2020-03-27T16:24:03.657 INFO:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2020-03-27T16:24:03.742 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-03-27T16:24:03.749 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-03-27T16:24:03.749 INFO:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2020-03-27T16:24:03.753 INFO:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2020-03-27T16:24:03.755 INFO:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2020-03-27T16:24:03.839 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-03-27T16:24:03.895 INFO:teuthology.run_tasks:Running task kernel... 2020-03-27T16:24:03.915 DEBUG:teuthology.task.kernel:normalized config {'osd.9': {'sha1': 'distro', 'kdb': True}, 'osd.8': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'client.2': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'osd.11': {'sha1': 'distro', 'kdb': True}, 'osd.10': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'mon.a': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2020-03-27T16:24:03.915 INFO:teuthology.task.kernel:config {'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mon.a': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-03-27T16:24:03.916 INFO:teuthology.orchestra.run.smithi189:> uname -r 2020-03-27T16:24:04.005 INFO:teuthology.orchestra.run.smithi189.stdout:3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:24:04.005 INFO:teuthology.task.kernel:Running kernel on smithi189: 3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:24:04.005 INFO:teuthology.orchestra.run.smithi189:> sudo yum install -y kernel 2020-03-27T16:24:04.924 INFO:teuthology.orchestra.run.smithi189.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2020-03-27T16:24:05.021 INFO:teuthology.orchestra.run.smithi189.stdout:Determining fastest mirrors 2020-03-27T16:24:05.536 INFO:teuthology.orchestra.run.smithi189.stdout: * base: mirror.umd.edu 2020-03-27T16:24:05.538 INFO:teuthology.orchestra.run.smithi189.stdout: * epel: download-cc-rdu01.fedoraproject.org 2020-03-27T16:24:05.538 INFO:teuthology.orchestra.run.smithi189.stdout: * extras: mirror.vcu.edu 2020-03-27T16:24:05.539 INFO:teuthology.orchestra.run.smithi189.stdout: * updates: mirror.siena.edu 2020-03-27T16:24:08.565 INFO:teuthology.orchestra.run.smithi189.stdout:Resolving Dependencies 2020-03-27T16:24:08.565 INFO:teuthology.orchestra.run.smithi189.stdout:--> Running transaction check 2020-03-27T16:24:08.566 INFO:teuthology.orchestra.run.smithi189.stdout:---> Package kernel.x86_64 0:3.10.0-1062.18.1.el7 will be installed 2020-03-27T16:24:09.734 INFO:teuthology.orchestra.run.smithi189.stdout:--> Finished Dependency Resolution 2020-03-27T16:24:10.487 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:10.487 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies Resolved 2020-03-27T16:24:10.488 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:10.489 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2020-03-27T16:24:10.489 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2020-03-27T16:24:10.489 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2020-03-27T16:24:10.489 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2020-03-27T16:24:10.489 INFO:teuthology.orchestra.run.smithi189.stdout: kernel x86_64 3.10.0-1062.18.1.el7 updates 50 M 2020-03-27T16:24:10.489 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:10.489 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2020-03-27T16:24:10.490 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2020-03-27T16:24:10.490 INFO:teuthology.orchestra.run.smithi189.stdout:Install 1 Package 2020-03-27T16:24:10.490 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:10.491 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 50 M 2020-03-27T16:24:10.491 INFO:teuthology.orchestra.run.smithi189.stdout:Installed size: 64 M 2020-03-27T16:24:10.491 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading packages: 2020-03-27T16:24:10.491 INFO:teuthology.orchestra.run.smithi189.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2020-03-27T16:24:11.380 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2020-03-27T16:24:11.580 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2020-03-27T16:24:12.455 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded 2020-03-27T16:24:12.456 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2020-03-27T16:24:47.892 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:24:48.495 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:24:48.495 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:48.495 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2020-03-27T16:24:48.495 INFO:teuthology.orchestra.run.smithi189.stdout: kernel.x86_64 0:3.10.0-1062.18.1.el7 2020-03-27T16:24:48.496 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:24:48.496 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2020-03-27T16:24:48.550 INFO:teuthology.orchestra.run.smithi189:> rpm -q kernel --last | head -n 1 2020-03-27T16:24:49.001 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:24:15 PM UTC 2020-03-27T16:24:49.003 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:24:49.004 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.12.1.el7.x86_64 Expected: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:24:49.004 INFO:teuthology.orchestra.run.smithi107:> uname -r 2020-03-27T16:24:49.135 INFO:teuthology.orchestra.run.smithi107.stdout:3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:24:49.135 INFO:teuthology.task.kernel:Running kernel on smithi107: 3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:24:49.136 INFO:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2020-03-27T16:24:50.129 INFO:teuthology.orchestra.run.smithi107.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2020-03-27T16:24:50.244 INFO:teuthology.orchestra.run.smithi107.stdout:Determining fastest mirrors 2020-03-27T16:24:50.769 INFO:teuthology.orchestra.run.smithi107.stdout: * base: mirror.umd.edu 2020-03-27T16:24:50.778 INFO:teuthology.orchestra.run.smithi107.stdout: * epel: download-cc-rdu01.fedoraproject.org 2020-03-27T16:24:50.778 INFO:teuthology.orchestra.run.smithi107.stdout: * extras: mirror.vcu.edu 2020-03-27T16:24:50.779 INFO:teuthology.orchestra.run.smithi107.stdout: * updates: mirror.siena.edu 2020-03-27T16:24:54.112 INFO:teuthology.orchestra.run.smithi107.stdout:Resolving Dependencies 2020-03-27T16:24:54.113 INFO:teuthology.orchestra.run.smithi107.stdout:--> Running transaction check 2020-03-27T16:24:54.113 INFO:teuthology.orchestra.run.smithi107.stdout:---> Package kernel.x86_64 0:3.10.0-1062.18.1.el7 will be installed 2020-03-27T16:24:55.399 INFO:teuthology.orchestra.run.smithi107.stdout:--> Finished Dependency Resolution 2020-03-27T16:24:56.151 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:24:56.151 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies Resolved 2020-03-27T16:24:56.152 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:24:56.153 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-03-27T16:24:56.153 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2020-03-27T16:24:56.153 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-03-27T16:24:56.153 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-03-27T16:24:56.153 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 3.10.0-1062.18.1.el7 updates 50 M 2020-03-27T16:24:56.153 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:24:56.153 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-03-27T16:24:56.154 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-03-27T16:24:56.154 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2020-03-27T16:24:56.154 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:24:56.154 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 50 M 2020-03-27T16:24:56.155 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 64 M 2020-03-27T16:24:56.155 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading packages: 2020-03-27T16:24:56.155 INFO:teuthology.orchestra.run.smithi107.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2020-03-27T16:24:57.025 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-03-27T16:24:57.222 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-03-27T16:24:58.092 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded 2020-03-27T16:24:58.093 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-03-27T16:25:33.371 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:25:33.926 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:25:33.927 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:25:33.927 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-03-27T16:25:33.927 INFO:teuthology.orchestra.run.smithi107.stdout: kernel.x86_64 0:3.10.0-1062.18.1.el7 2020-03-27T16:25:33.927 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:25:33.927 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-03-27T16:25:33.978 INFO:teuthology.orchestra.run.smithi107:> rpm -q kernel --last | head -n 1 2020-03-27T16:25:34.390 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:25:00 PM UTC 2020-03-27T16:25:34.392 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:25:34.393 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.12.1.el7.x86_64 Expected: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:25:34.393 INFO:teuthology.orchestra.run.smithi097:> uname -r 2020-03-27T16:25:34.519 INFO:teuthology.orchestra.run.smithi097.stdout:3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:25:34.519 INFO:teuthology.task.kernel:Running kernel on smithi097: 3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:25:34.519 INFO:teuthology.orchestra.run.smithi097:> sudo yum install -y kernel 2020-03-27T16:25:35.431 INFO:teuthology.orchestra.run.smithi097.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2020-03-27T16:25:35.549 INFO:teuthology.orchestra.run.smithi097.stdout:Determining fastest mirrors 2020-03-27T16:25:36.049 INFO:teuthology.orchestra.run.smithi097.stdout: * base: mirror.umd.edu 2020-03-27T16:25:36.054 INFO:teuthology.orchestra.run.smithi097.stdout: * epel: download-cc-rdu01.fedoraproject.org 2020-03-27T16:25:36.055 INFO:teuthology.orchestra.run.smithi097.stdout: * extras: mirror.vcu.edu 2020-03-27T16:25:36.055 INFO:teuthology.orchestra.run.smithi097.stdout: * updates: mirror.siena.edu 2020-03-27T16:25:39.489 INFO:teuthology.orchestra.run.smithi097.stdout:Resolving Dependencies 2020-03-27T16:25:39.490 INFO:teuthology.orchestra.run.smithi097.stdout:--> Running transaction check 2020-03-27T16:25:39.490 INFO:teuthology.orchestra.run.smithi097.stdout:---> Package kernel.x86_64 0:3.10.0-1062.18.1.el7 will be installed 2020-03-27T16:25:40.813 INFO:teuthology.orchestra.run.smithi097.stdout:--> Finished Dependency Resolution 2020-03-27T16:25:41.655 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:25:41.656 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies Resolved 2020-03-27T16:25:41.656 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:25:41.656 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2020-03-27T16:25:41.656 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2020-03-27T16:25:41.656 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2020-03-27T16:25:41.656 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2020-03-27T16:25:41.657 INFO:teuthology.orchestra.run.smithi097.stdout: kernel x86_64 3.10.0-1062.18.1.el7 updates 50 M 2020-03-27T16:25:41.657 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:25:41.657 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2020-03-27T16:25:41.657 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2020-03-27T16:25:41.657 INFO:teuthology.orchestra.run.smithi097.stdout:Install 1 Package 2020-03-27T16:25:41.657 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:25:41.658 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 50 M 2020-03-27T16:25:41.658 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 64 M 2020-03-27T16:25:41.658 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading packages: 2020-03-27T16:25:41.666 INFO:teuthology.orchestra.run.smithi097.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2020-03-27T16:25:42.641 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2020-03-27T16:25:42.840 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2020-03-27T16:25:43.767 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded 2020-03-27T16:25:43.768 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2020-03-27T16:26:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:26:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-3.10.0-1062.18.1.el7.x86_64 1/1 2020-03-27T16:26:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:26:19.090 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2020-03-27T16:26:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: kernel.x86_64 0:3.10.0-1062.18.1.el7 2020-03-27T16:26:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:26:19.090 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2020-03-27T16:26:19.141 INFO:teuthology.orchestra.run.smithi097:> rpm -q kernel --last | head -n 1 2020-03-27T16:26:19.535 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:25:46 PM UTC 2020-03-27T16:26:19.538 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:19.538 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.12.1.el7.x86_64 Expected: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:19.538 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-03-27T16:26:19.538 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-03-27T16:26:19.538 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-03-27T16:26:19.538 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-03-27T16:26:19.538 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-03-27T16:26:19.538 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2020-03-27T16:26:19.539 INFO:teuthology.orchestra.run.smithi097:> rpm -q kernel --last | head -n 1 2020-03-27T16:26:19.811 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:25:46 PM UTC 2020-03-27T16:26:19.814 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:19.814 INFO:teuthology.orchestra.run.smithi097:> sudo rpm -qi grub2-tools 2020-03-27T16:26:19.944 INFO:teuthology.orchestra.run.smithi097.stdout:Name : grub2-tools 2020-03-27T16:26:19.944 INFO:teuthology.orchestra.run.smithi097.stdout:Epoch : 1 2020-03-27T16:26:19.945 INFO:teuthology.orchestra.run.smithi097.stdout:Version : 2.02 2020-03-27T16:26:19.945 INFO:teuthology.orchestra.run.smithi097.stdout:Release : 0.76.el7.centos 2020-03-27T16:26:19.945 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: x86_64 2020-03-27T16:26:19.945 INFO:teuthology.orchestra.run.smithi097.stdout:Install Date: Tue 11 Feb 2020 03:34:40 PM UTC 2020-03-27T16:26:19.945 INFO:teuthology.orchestra.run.smithi097.stdout:Group : System Environment/Base 2020-03-27T16:26:19.945 INFO:teuthology.orchestra.run.smithi097.stdout:Size : 10080361 2020-03-27T16:26:19.945 INFO:teuthology.orchestra.run.smithi097.stdout:License : GPLv3+ 2020-03-27T16:26:19.945 INFO:teuthology.orchestra.run.smithi097.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2020-03-27T16:26:19.946 INFO:teuthology.orchestra.run.smithi097.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2020-03-27T16:26:19.946 INFO:teuthology.orchestra.run.smithi097.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2020-03-27T16:26:19.946 INFO:teuthology.orchestra.run.smithi097.stdout:Build Host : kbuilder.bsys.centos.org 2020-03-27T16:26:19.946 INFO:teuthology.orchestra.run.smithi097.stdout:Relocations : (not relocatable) 2020-03-27T16:26:19.946 INFO:teuthology.orchestra.run.smithi097.stdout:Packager : CentOS BuildSystem 2020-03-27T16:26:19.946 INFO:teuthology.orchestra.run.smithi097.stdout:Vendor : CentOS 2020-03-27T16:26:19.946 INFO:teuthology.orchestra.run.smithi097.stdout:URL : http://www.gnu.org/software/grub/ 2020-03-27T16:26:19.947 INFO:teuthology.orchestra.run.smithi097.stdout:Summary : Support tools for GRUB. 2020-03-27T16:26:19.947 INFO:teuthology.orchestra.run.smithi097.stdout:Description : 2020-03-27T16:26:19.947 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:26:19.947 INFO:teuthology.orchestra.run.smithi097.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-03-27T16:26:19.947 INFO:teuthology.orchestra.run.smithi097.stdout:customizable bootloader with modular architecture. It supports a rich 2020-03-27T16:26:19.947 INFO:teuthology.orchestra.run.smithi097.stdout:variety of kernel formats, file systems, computer architectures and 2020-03-27T16:26:19.947 INFO:teuthology.orchestra.run.smithi097.stdout:hardware devices. 2020-03-27T16:26:19.947 INFO:teuthology.orchestra.run.smithi097.stdout: 2020-03-27T16:26:19.948 INFO:teuthology.orchestra.run.smithi097.stdout:This subpackage provides tools for support of all platforms. 2020-03-27T16:26:19.948 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-03-27T16:26:19.949 INFO:teuthology.task.kernel:Updating grub on smithi097 to boot 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:19.949 INFO:teuthology.orchestra.run.smithi097:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-03-27T16:26:20.481 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2020-03-27T16:26:20.611 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.18.1.el7.x86_64.img 2020-03-27T16:26:20.905 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:26:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.12.1.el7.x86_64.img 2020-03-27T16:26:20.969 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2020-03-27T16:26:20.985 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2020-03-27T16:26:21.013 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-0-rescue-11867a3080154962a87601c586b1198d 2020-03-27T16:26:21.022 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initramfs-0-rescue-11867a3080154962a87601c586b1198d.img 2020-03-27T16:26:22.208 INFO:teuthology.orchestra.run.smithi097.stderr:done 2020-03-27T16:26:22.210 INFO:teuthology.orchestra.run.smithi097:> mktemp 2020-03-27T16:26:22.275 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.1rF8FaGy9m 2020-03-27T16:26:22.275 INFO:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1rF8FaGy9m 2020-03-27T16:26:22.345 INFO:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.1rF8FaGy9m 2020-03-27T16:26:22.467 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.1rF8FaGy9m is 6KB 2020-03-27T16:26:22.521 INFO:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.1rF8FaGy9m 2020-03-27T16:26:22.566 INFO:teuthology.orchestra.run.smithi097:> sudo grub2-set-default 0 2020-03-27T16:26:22.822 INFO:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2020-03-27T16:26:22.826 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2020-03-27T16:26:22.826 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi189.front.sepia.ceph.com, path=None, version=distro) 2020-03-27T16:26:22.826 INFO:teuthology.orchestra.run.smithi189:> rpm -q kernel --last | head -n 1 2020-03-27T16:26:23.200 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:24:15 PM UTC 2020-03-27T16:26:23.202 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:23.202 INFO:teuthology.orchestra.run.smithi189:> sudo rpm -qi grub2-tools 2020-03-27T16:26:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:Name : grub2-tools 2020-03-27T16:26:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:Epoch : 1 2020-03-27T16:26:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:Version : 2.02 2020-03-27T16:26:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:Release : 0.76.el7.centos 2020-03-27T16:26:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: x86_64 2020-03-27T16:26:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:Install Date: Tue 11 Feb 2020 03:34:40 PM UTC 2020-03-27T16:26:23.360 INFO:teuthology.orchestra.run.smithi189.stdout:Group : System Environment/Base 2020-03-27T16:26:23.360 INFO:teuthology.orchestra.run.smithi189.stdout:Size : 10080361 2020-03-27T16:26:23.360 INFO:teuthology.orchestra.run.smithi189.stdout:License : GPLv3+ 2020-03-27T16:26:23.360 INFO:teuthology.orchestra.run.smithi189.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2020-03-27T16:26:23.360 INFO:teuthology.orchestra.run.smithi189.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2020-03-27T16:26:23.360 INFO:teuthology.orchestra.run.smithi189.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2020-03-27T16:26:23.360 INFO:teuthology.orchestra.run.smithi189.stdout:Build Host : kbuilder.bsys.centos.org 2020-03-27T16:26:23.360 INFO:teuthology.orchestra.run.smithi189.stdout:Relocations : (not relocatable) 2020-03-27T16:26:23.361 INFO:teuthology.orchestra.run.smithi189.stdout:Packager : CentOS BuildSystem 2020-03-27T16:26:23.361 INFO:teuthology.orchestra.run.smithi189.stdout:Vendor : CentOS 2020-03-27T16:26:23.361 INFO:teuthology.orchestra.run.smithi189.stdout:URL : http://www.gnu.org/software/grub/ 2020-03-27T16:26:23.361 INFO:teuthology.orchestra.run.smithi189.stdout:Summary : Support tools for GRUB. 2020-03-27T16:26:23.361 INFO:teuthology.orchestra.run.smithi189.stdout:Description : 2020-03-27T16:26:23.361 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:26:23.361 INFO:teuthology.orchestra.run.smithi189.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-03-27T16:26:23.361 INFO:teuthology.orchestra.run.smithi189.stdout:customizable bootloader with modular architecture. It supports a rich 2020-03-27T16:26:23.362 INFO:teuthology.orchestra.run.smithi189.stdout:variety of kernel formats, file systems, computer architectures and 2020-03-27T16:26:23.362 INFO:teuthology.orchestra.run.smithi189.stdout:hardware devices. 2020-03-27T16:26:23.362 INFO:teuthology.orchestra.run.smithi189.stdout: 2020-03-27T16:26:23.362 INFO:teuthology.orchestra.run.smithi189.stdout:This subpackage provides tools for support of all platforms. 2020-03-27T16:26:23.363 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-03-27T16:26:23.363 INFO:teuthology.task.kernel:Updating grub on smithi189 to boot 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:23.363 INFO:teuthology.orchestra.run.smithi189:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-03-27T16:26:23.836 INFO:teuthology.orchestra.run.smithi189.stderr:Generating grub configuration file ... 2020-03-27T16:26:23.966 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:23.981 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.18.1.el7.x86_64.img 2020-03-27T16:26:24.221 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:26:24.243 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.12.1.el7.x86_64.img 2020-03-27T16:26:24.277 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2020-03-27T16:26:24.295 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2020-03-27T16:26:24.324 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-0-rescue-11867a3080154962a87601c586b1198d 2020-03-27T16:26:24.333 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initramfs-0-rescue-11867a3080154962a87601c586b1198d.img 2020-03-27T16:26:25.491 INFO:teuthology.orchestra.run.smithi189.stderr:done 2020-03-27T16:26:25.492 INFO:teuthology.orchestra.run.smithi189:> mktemp 2020-03-27T16:26:25.546 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.26oeAN7Mqu 2020-03-27T16:26:25.547 INFO:teuthology.orchestra.run.smithi189:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.26oeAN7Mqu 2020-03-27T16:26:25.612 INFO:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.26oeAN7Mqu 2020-03-27T16:26:25.730 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.26oeAN7Mqu is 6KB 2020-03-27T16:26:25.781 INFO:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.26oeAN7Mqu 2020-03-27T16:26:25.829 INFO:teuthology.orchestra.run.smithi189:> sudo grub2-set-default 0 2020-03-27T16:26:26.064 INFO:teuthology.orchestra.run.smithi189:> sudo shutdown -r now 2020-03-27T16:26:26.067 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-03-27T16:26:26.068 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2020-03-27T16:26:26.068 INFO:teuthology.orchestra.run.smithi107:> rpm -q kernel --last | head -n 1 2020-03-27T16:26:26.432 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-3.10.0-1062.18.1.el7.x86_64 Fri 27 Mar 2020 04:25:00 PM UTC 2020-03-27T16:26:26.434 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:26.434 INFO:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2020-03-27T16:26:26.596 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2020-03-27T16:26:26.596 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2020-03-27T16:26:26.596 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.02 2020-03-27T16:26:26.597 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 0.76.el7.centos 2020-03-27T16:26:26.597 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2020-03-27T16:26:26.597 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Tue 11 Feb 2020 03:34:40 PM UTC 2020-03-27T16:26:26.597 INFO:teuthology.orchestra.run.smithi107.stdout:Group : System Environment/Base 2020-03-27T16:26:26.597 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 10080361 2020-03-27T16:26:26.597 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2020-03-27T16:26:26.597 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2020-03-27T16:26:26.598 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2020-03-27T16:26:26.598 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2020-03-27T16:26:26.598 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : kbuilder.bsys.centos.org 2020-03-27T16:26:26.598 INFO:teuthology.orchestra.run.smithi107.stdout:Relocations : (not relocatable) 2020-03-27T16:26:26.598 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : CentOS BuildSystem 2020-03-27T16:26:26.598 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2020-03-27T16:26:26.598 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2020-03-27T16:26:26.599 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2020-03-27T16:26:26.599 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2020-03-27T16:26:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:26:26.599 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-03-27T16:26:26.599 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2020-03-27T16:26:26.599 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2020-03-27T16:26:26.599 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2020-03-27T16:26:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-03-27T16:26:26.600 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2020-03-27T16:26:26.600 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-03-27T16:26:26.601 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:26.601 INFO:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-03-27T16:26:27.085 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2020-03-27T16:26:27.210 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.18.1.el7.x86_64 2020-03-27T16:26:27.225 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.18.1.el7.x86_64.img 2020-03-27T16:26:27.465 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.12.1.el7.x86_64 2020-03-27T16:26:27.489 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.12.1.el7.x86_64.img 2020-03-27T16:26:27.519 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2020-03-27T16:26:27.536 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2020-03-27T16:26:27.562 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-0-rescue-11867a3080154962a87601c586b1198d 2020-03-27T16:26:27.571 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initramfs-0-rescue-11867a3080154962a87601c586b1198d.img 2020-03-27T16:26:28.807 INFO:teuthology.orchestra.run.smithi107.stderr:done 2020-03-27T16:26:28.809 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-03-27T16:26:28.862 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.xsQODOAJv2 2020-03-27T16:26:28.862 INFO:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xsQODOAJv2 2020-03-27T16:26:28.926 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.xsQODOAJv2 2020-03-27T16:26:29.036 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.xsQODOAJv2 is 6KB 2020-03-27T16:26:29.084 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.xsQODOAJv2 2020-03-27T16:26:29.132 INFO:teuthology.orchestra.run.smithi107:> sudo grub2-set-default 0 2020-03-27T16:26:29.374 INFO:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2020-03-27T16:26:59.405 INFO:teuthology.misc:Re-opening connections... 2020-03-27T16:26:59.406 INFO:teuthology.misc:trying to connect to ubuntu@smithi189.front.sepia.ceph.com 2020-03-27T16:26:59.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:26:59.406 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:27:17.849 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2020-03-27T16:27:17.849 INFO:teuthology.misc:trying to connect to ubuntu@smithi097.front.sepia.ceph.com 2020-03-27T16:27:17.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:27:17.850 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi097.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:27:36.277 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2020-03-27T16:27:36.277 INFO:teuthology.misc:trying to connect to ubuntu@smithi107.front.sepia.ceph.com 2020-03-27T16:27:36.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:27:36.278 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:27:39.353 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2020-03-27T16:27:39.353 DEBUG:teuthology.misc:waited 39.9478051662 2020-03-27T16:27:40.354 INFO:teuthology.misc:trying to connect to ubuntu@smithi189.front.sepia.ceph.com 2020-03-27T16:27:40.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-03-27T16:27:40.354 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi189.front.sepia.ceph.com', 'timeout': 60} 2020-03-27T16:28:11.521 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-03-27T16:28:11.521 DEBUG:teuthology.task.console_log:Killing console logger for smithi107 2020-03-27T16:28:11.522 DEBUG:teuthology.task.console_log:Killing console logger for smithi189 2020-03-27T16:28:11.522 DEBUG:teuthology.task.console_log:Killing console logger for smithi097 2020-03-27T16:28:11.522 DEBUG:teuthology.task.console_log:Killing console logger for smithi107 2020-03-27T16:28:11.523 DEBUG:teuthology.task.console_log:Killing console logger for smithi097 2020-03-27T16:28:11.523 DEBUG:teuthology.task.console_log:Killing console logger for smithi189 2020-03-27T16:28:11.523 DEBUG:teuthology.exit:Finished running handlers