2020-02-05T20:18:19.249 INFO:root:teuthology version: 1.0.0-95fed4d 2020-02-05T20:18:19.249 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.9iEuuW.tmp -- --verbose --lock --description multimds:basic/{0-supported-random-distro$/{ubuntu_latest.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} --name pdonnell-2020-02-05_20:09:36-multimds:basic-wip-pdonnell-testing-20200205.163052-distro-basic-smithi --block --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2020-02-05_20:09:36-multimds:basic-wip-pdonnell-testing-20200205.163052-distro-basic-smithi/4735574 2020-02-05T20:18:19.309 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-05T20:18:19.372 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-02-05_20:09:36-multimds:basic-wip-pdonnell-testing-20200205.163052-distro-basic-smithi/4735574 branch: wip-pdonnell-testing-20200205.163052 description: multimds:basic/{0-supported-random-distro$/{ubuntu_latest.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} email: pdonnell@redhat.com first_in_suite: false job_id: '4735574' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-02-05_20:09:36-multimds:basic-wip-pdonnell-testing-20200205.163052-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-pdonnell-testing-20200205.163052 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 fuse default permissions: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding max_mds: 9 sha1: f377c940bca6177a8fe3ff574d24f5243313bbad ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: f377c940bca6177a8fe3ff574d24f5243313bbad thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20200205.163052 sha1: f377c940bca6177a8fe3ff574d24f5243313bbad owner: scheduled_pdonnell@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - mds.a - mds.b - mds.c - mds.d - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mgr.x - mds.e - mds.f - mds.g - mds.h - mds.i - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - client.1 sha1: f377c940bca6177a8fe3ff574d24f5243313bbad suite: multimds:basic suite_branch: wip-pdonnell-testing-20200205.163052 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200205.163052/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: f377c940bca6177a8fe3ff574d24f5243313bbad tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - ceph: null - ceph-fuse: null - check-counter: counters: mds: - mds.exported - mds.imported - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_exports teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2475 2020-02-05T20:18:19.373 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200205.163052/qa; will attempt to use it 2020-02-05T20:18:19.373 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200205.163052/qa/tasks 2020-02-05T20:18:19.373 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-02-05T20:18:19.375 INFO:teuthology.task.internal:Checking packages... 2020-02-05T20:18:19.387 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'f377c940bca6177a8fe3ff574d24f5243313bbad' 2020-02-05T20:18:19.388 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-02-05T20:18:19.388 INFO:teuthology.packaging:ref: None 2020-02-05T20:18:19.388 INFO:teuthology.packaging:tag: None 2020-02-05T20:18:19.388 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20200205.163052 2020-02-05T20:18:19.388 INFO:teuthology.packaging:sha1: f377c940bca6177a8fe3ff574d24f5243313bbad 2020-02-05T20:18:19.388 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-pdonnell-testing-20200205.163052 2020-02-05T20:18:19.549 INFO:teuthology.task.internal:Found packages for ceph version 15.1.0-313-gf377c94-1bionic 2020-02-05T20:18:19.549 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-02-05T20:18:19.577 INFO:teuthology.task.internal:no buildpackages task found 2020-02-05T20:18:19.577 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-02-05T20:18:19.699 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-02-05T20:18:19.699 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-05T20:18:19.755 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_pdonnell@teuthology', 'description': '/home/teuthworker/archive/pdonnell-2020-02-05_20:09:36-multimds:basic-wip-pdonnell-testing-20200205.163052-distro-basic-smithi/4735574', 'machine_type': 'smithi'} 2020-02-05T20:18:19.773 DEBUG:teuthology.lock.ops:locked ubuntu@smithi006.front.sepia.ceph.com, ubuntu@smithi013.front.sepia.ceph.com, ubuntu@smithi133.front.sepia.ceph.com 2020-02-05T20:18:19.861 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-05T20:18:20.063 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of ubuntu 18.04 2020-02-05T20:18:20.065 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 18.04 2020-02-05T20:18:20.072 INFO:teuthology.provision.fog.smithi013:Scheduling deploy of ubuntu 18.04 2020-02-05T20:18:20.512 INFO:teuthology.orchestra.console:Power off smithi133 2020-02-05T20:18:20.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-05T20:18:20.531 INFO:teuthology.orchestra.console:Power off smithi006 2020-02-05T20:18:20.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-05T20:18:20.541 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:20.562 INFO:teuthology.orchestra.console:Power off smithi013 2020-02-05T20:18:20.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-05T20:18:20.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:20.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:20.686 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2020-02-05T20:18:20.705 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2020-02-05T20:18:20.719 INFO:teuthology.orchestra.console:Power off for smithi013 completed 2020-02-05T20:18:20.788 INFO:teuthology.orchestra.console:Power on smithi133 2020-02-05T20:18:20.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-05T20:18:20.807 INFO:teuthology.orchestra.console:Power on smithi006 2020-02-05T20:18:20.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-05T20:18:20.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:20.825 INFO:teuthology.orchestra.console:Power on smithi013 2020-02-05T20:18:20.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-05T20:18:20.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:20.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:24.842 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:24.857 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:24.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:25.068 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2020-02-05T20:18:25.169 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2020-02-05T20:18:28.955 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:28.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-05T20:18:29.165 INFO:teuthology.orchestra.console:Power on for smithi133 completed 2020-02-05T20:18:29.199 INFO:teuthology.orchestra.console:Power on for smithi013 completed 2020-02-05T20:18:29.267 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2020-02-05T20:18:29.300 INFO:teuthology.provision.fog.smithi013:Waiting for deploy to finish 2020-02-05T20:21:00.906 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:12.012 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:25.470 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:31.079 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:34.553 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:36.471 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:43.611 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:45.527 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:52.662 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:54.584 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:21:55.414 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:22:04.474 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:22:13.534 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:22:22.618 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:22:58.690 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:22:58.793 INFO:teuthology.orchestra.run.smithi013:> hostname 2020-02-05T20:22:59.478 INFO:teuthology.orchestra.run.smithi013.stdout:smithi013.front.sepia.ceph.com 2020-02-05T20:22:59.478 INFO:teuthology.orchestra.run.smithi013:> grep smithi013.front.sepia.ceph.com /etc/hosts 2020-02-05T20:22:59.485 INFO:teuthology.orchestra.run.smithi013.stdout:172.21.15.13 smithi013.front.sepia.ceph.com smithi013 2020-02-05T20:22:59.485 INFO:teuthology.orchestra.run.smithi013:> sudo hostname smithi013 2020-02-05T20:22:59.578 INFO:teuthology.orchestra.run.smithi013:> sudo sed -i -e 's/smithi013.front.sepia.ceph.com/smithi013/g' /etc/hosts 2020-02-05T20:22:59.591 INFO:teuthology.orchestra.run.smithi013:> sudo sed -i -e 's/172.21.15.13/172.21.15.13/g' /etc/hosts 2020-02-05T20:22:59.649 INFO:teuthology.orchestra.run.smithi013:> sudo sed -i -e 's/smithi013.front.sepia.ceph.com/smithi013/g' /etc/hostname 2020-02-05T20:22:59.711 INFO:teuthology.orchestra.run.smithi013:> sudo hostname smithi013 2020-02-05T20:22:59.767 INFO:teuthology.provision.fog.smithi013:Deploy complete! 2020-02-05T20:22:59.769 DEBUG:teuthology.parallel:result is None 2020-02-05T20:23:00.187 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:00.199 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-02-05T20:23:00.586 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:00.699 INFO:teuthology.orchestra.run.smithi006:> hostname 2020-02-05T20:23:01.367 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2020-02-05T20:23:01.368 INFO:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2020-02-05T20:23:01.421 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2020-02-05T20:23:01.421 INFO:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2020-02-05T20:23:01.485 INFO:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2020-02-05T20:23:01.541 INFO:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2020-02-05T20:23:01.595 INFO:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2020-02-05T20:23:01.658 INFO:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2020-02-05T20:23:01.712 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2020-02-05T20:23:01.714 DEBUG:teuthology.parallel:result is None 2020-02-05T20:23:06.201 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:06.211 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-02-05T20:23:12.216 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:12.414 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-02-05T20:23:18.417 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:18.428 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-02-05T20:23:24.430 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:24.535 INFO:teuthology.orchestra.run.smithi133:> hostname 2020-02-05T20:23:25.245 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2020-02-05T20:23:25.245 INFO:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2020-02-05T20:23:25.252 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2020-02-05T20:23:25.253 INFO:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2020-02-05T20:23:25.355 INFO:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2020-02-05T20:23:25.370 INFO:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2020-02-05T20:23:25.428 INFO:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2020-02-05T20:23:25.487 INFO:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2020-02-05T20:23:25.541 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2020-02-05T20:23:25.543 DEBUG:teuthology.parallel:result is None 2020-02-05T20:23:25.744 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2020-02-05T20:23:25.745 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-05T20:23:25.761 INFO:teuthology.lock.ops:Checking smithi013.front.sepia.ceph.com 2020-02-05T20:23:25.761 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-05T20:23:25.771 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2020-02-05T20:23:25.771 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-05T20:23:25.786 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2020-02-05T20:23:25.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-05T20:23:25.787 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:25.863 INFO:teuthology.orchestra.run.smithi006:> true 2020-02-05T20:23:26.107 INFO:teuthology.orchestra.run.smithi006:> uname -m 2020-02-05T20:23:26.156 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2020-02-05T20:23:26.157 INFO:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2020-02-05T20:23:26.204 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2020-02-05T20:23:26.204 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-02-05T20:23:26.204 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2020-02-05T20:23:26.204 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2020-02-05T20:23:26.204 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-02-05T20:23:26.205 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="18.04" 2020-02-05T20:23:26.205 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2020-02-05T20:23:26.205 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-02-05T20:23:26.205 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-02-05T20:23:26.205 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-02-05T20:23:26.205 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=bionic 2020-02-05T20:23:26.205 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=bionic 2020-02-05T20:23:26.206 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2020-02-05T20:23:26.218 INFO:teuthology.lock.ops:Updating [smithi013.front.sepia.ceph.com]: set os type and version on server 2020-02-05T20:23:26.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-05T20:23:26.219 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:26.296 INFO:teuthology.orchestra.run.smithi013:> true 2020-02-05T20:23:26.543 INFO:teuthology.orchestra.run.smithi013:> uname -m 2020-02-05T20:23:26.591 INFO:teuthology.orchestra.run.smithi013.stdout:x86_64 2020-02-05T20:23:26.593 INFO:teuthology.orchestra.run.smithi013:> cat /etc/os-release 2020-02-05T20:23:26.638 INFO:teuthology.orchestra.run.smithi013.stdout:NAME="Ubuntu" 2020-02-05T20:23:26.639 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-02-05T20:23:26.639 INFO:teuthology.orchestra.run.smithi013.stdout:ID=ubuntu 2020-02-05T20:23:26.639 INFO:teuthology.orchestra.run.smithi013.stdout:ID_LIKE=debian 2020-02-05T20:23:26.639 INFO:teuthology.orchestra.run.smithi013.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-02-05T20:23:26.639 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_ID="18.04" 2020-02-05T20:23:26.639 INFO:teuthology.orchestra.run.smithi013.stdout:HOME_URL="https://www.ubuntu.com/" 2020-02-05T20:23:26.639 INFO:teuthology.orchestra.run.smithi013.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-02-05T20:23:26.640 INFO:teuthology.orchestra.run.smithi013.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-02-05T20:23:26.640 INFO:teuthology.orchestra.run.smithi013.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-02-05T20:23:26.640 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_CODENAME=bionic 2020-02-05T20:23:26.640 INFO:teuthology.orchestra.run.smithi013.stdout:UBUNTU_CODENAME=bionic 2020-02-05T20:23:26.640 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server 2020-02-05T20:23:26.654 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2020-02-05T20:23:26.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-05T20:23:26.655 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:26.729 INFO:teuthology.orchestra.run.smithi133:> true 2020-02-05T20:23:26.971 INFO:teuthology.orchestra.run.smithi133:> uname -m 2020-02-05T20:23:27.026 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2020-02-05T20:23:27.027 INFO:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2020-02-05T20:23:27.074 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2020-02-05T20:23:27.074 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-02-05T20:23:27.074 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2020-02-05T20:23:27.075 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2020-02-05T20:23:27.075 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-02-05T20:23:27.075 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="18.04" 2020-02-05T20:23:27.075 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2020-02-05T20:23:27.075 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-02-05T20:23:27.075 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-02-05T20:23:27.075 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-02-05T20:23:27.076 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=bionic 2020-02-05T20:23:27.076 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=bionic 2020-02-05T20:23:27.076 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2020-02-05T20:23:27.091 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-02-05T20:23:27.137 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDINJFaGV8RdG/RdM5/wt1k5Xc9c/Xj4OFG8S8pP9aoGH7bZ6FzhbcTW+hR+9Mk9n90yUd8ADK+lchX5ArJ1X3laK1MlymHnrzkWgUSwbWmJT3WSJAhusYOKGicZ6cnTYU7kwX9ZC+qNe07DbjE1uYlMi9PlUXCEE7T9hxz+E2IfDrQi/H5Iw6jUFhDsCTmePa915SMUTKjX9BqtR2DLHeTROTjThP/460ji3I9t/uhC970ATYIFiHWxulATiXkLQJ/KHmt5+7cgjeMp7M7mLRVEUqi9Vvz7ySDm0pUJ38vJY5QHSEBf0qbdkuEODMGwsJ4LHuQC39E+RMIsMnFEh1D smithi013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/I6RakiJJzp7iVtm3LWPDiJCFU2TFUUN+tIenpS1uMEPnEETua41yjSlrWXc9ZDUYH4udAzMToiuw4ZGTB9VCcxOPhz+x895M3nipEK7JWtKgz2dgrLcfDFM5vLnJKc+9yMFm/3lbkXn1nrc81eWBvlPWn27WSWkP5jFWl6sYD0y8ZvotjmVa2m8UDi/W/iLiACvX/n19hzsQ9k2LcmVNXacmILLbBxsX0IxKz884Z18nCVky331SXlg3aoGtw0+zROLCM/x7CMBQZLyW4dijHJan8hpM2ZiOezXdfPc0vRom177u8+n6I3y2riFytdvkQPfQLgCmeLKwxf5K3/FL smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDILGq2V9G2b8B+s+pOUxGMs2hxulKr5KEHW4z28r1s2wtJEa0CTsn5aJFaP0YAiZth9fAa9/EPiWXSCuN7A/6RNoCJ4DSXPfjZFiG+NopNqBlX56pwATtaFPDUxmyAjsOx/zSG0a9d3019g36PiosGNsbZJGcu/a+aBYyn7QhBxoNQzLOYRbI3ZrpU6VHdpVNzMb4kbs0m5jTi+uGfLgIqTOWb3CNtfx/dC9VltXNZauhTpkVwi188u+oVJz/TZCONTB3oLlwvNHYUFaIUtt+LDbY97O8/4pZpfJt/Jw58tUENmJVYHGXXg0LaTQIJECEDizhSh5a1HW9KgpxiVQQh 2020-02-05T20:23:27.138 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-05T20:23:27.203 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-02-05T20:23:27.247 INFO:teuthology.task.internal:Saving configuration 2020-02-05T20:23:27.267 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-02-05T20:23:27.279 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-02-05T20:23:27.293 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-05 20:18:19.761920', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi006.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICfoQ/kG+C71Nz9Ai1Hwcv+uafpeT/P9wxJiQgiSl+mp', u'description': u'/home/teuthworker/archive/pdonnell-2020-02-05_20:09:36-multimds:basic-wip-pdonnell-testing-20200205.163052-distro-basic-smithi/4735574'} 2020-02-05T20:23:27.309 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-05 20:18:19.761940', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi013.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINVh96F7na1IrUC4UjNNpEnbFY6zY/eND2L8MyLRMZTY', u'description': u'/home/teuthworker/archive/pdonnell-2020-02-05_20:09:36-multimds:basic-wip-pdonnell-testing-20200205.163052-distro-basic-smithi/4735574'} 2020-02-05T20:23:27.324 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-05 20:18:19.761956', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi133.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMWFEMwRQW9e6mPpgXthPILicVEDRcBekI/0an0AbTVI', u'description': u'/home/teuthworker/archive/pdonnell-2020-02-05_20:09:36-multimds:basic-wip-pdonnell-testing-20200205.163052-distro-basic-smithi/4735574'} 2020-02-05T20:23:27.324 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-02-05T20:23:27.334 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2020-02-05T20:23:27.334 INFO:teuthology.task.internal:roles: ubuntu@smithi013.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'mds.e', 'mds.f', 'mds.g', 'mds.h', 'mds.i', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-02-05T20:23:27.335 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['client.0', 'client.1'] 2020-02-05T20:23:27.335 INFO:teuthology.run_tasks:Running task console_log... 2020-02-05T20:23:27.476 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-05T20:23:27.477 INFO:teuthology.run_tasks:Running task internal.connect... 2020-02-05T20:23:27.488 INFO:teuthology.task.internal:Opening connections... 2020-02-05T20:23:27.488 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2020-02-05T20:23:27.489 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi006.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:27.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2020-02-05T20:23:27.567 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi133.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:27.644 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi013.front.sepia.ceph.com 2020-02-05T20:23:27.644 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2020-02-05T20:23:27.717 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-02-05T20:23:27.729 INFO:teuthology.orchestra.run.smithi006:> uname -m 2020-02-05T20:23:27.760 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2020-02-05T20:23:27.761 INFO:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2020-02-05T20:23:27.808 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2020-02-05T20:23:27.808 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-02-05T20:23:27.808 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2020-02-05T20:23:27.808 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2020-02-05T20:23:27.808 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-02-05T20:23:27.809 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="18.04" 2020-02-05T20:23:27.809 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2020-02-05T20:23:27.809 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-02-05T20:23:27.809 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-02-05T20:23:27.809 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-02-05T20:23:27.809 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=bionic 2020-02-05T20:23:27.809 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=bionic 2020-02-05T20:23:27.810 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2020-02-05T20:23:27.825 INFO:teuthology.orchestra.run.smithi133:> uname -m 2020-02-05T20:23:27.837 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2020-02-05T20:23:27.838 INFO:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2020-02-05T20:23:27.889 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2020-02-05T20:23:27.889 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-02-05T20:23:27.890 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2020-02-05T20:23:27.890 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2020-02-05T20:23:27.890 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-02-05T20:23:27.890 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="18.04" 2020-02-05T20:23:27.890 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2020-02-05T20:23:27.890 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-02-05T20:23:27.890 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-02-05T20:23:27.891 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-02-05T20:23:27.891 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=bionic 2020-02-05T20:23:27.891 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=bionic 2020-02-05T20:23:27.891 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2020-02-05T20:23:27.902 INFO:teuthology.orchestra.run.smithi013:> uname -m 2020-02-05T20:23:27.909 INFO:teuthology.orchestra.run.smithi013.stdout:x86_64 2020-02-05T20:23:27.910 INFO:teuthology.orchestra.run.smithi013:> cat /etc/os-release 2020-02-05T20:23:27.959 INFO:teuthology.orchestra.run.smithi013.stdout:NAME="Ubuntu" 2020-02-05T20:23:27.959 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-02-05T20:23:27.959 INFO:teuthology.orchestra.run.smithi013.stdout:ID=ubuntu 2020-02-05T20:23:27.959 INFO:teuthology.orchestra.run.smithi013.stdout:ID_LIKE=debian 2020-02-05T20:23:27.959 INFO:teuthology.orchestra.run.smithi013.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-02-05T20:23:27.959 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_ID="18.04" 2020-02-05T20:23:27.959 INFO:teuthology.orchestra.run.smithi013.stdout:HOME_URL="https://www.ubuntu.com/" 2020-02-05T20:23:27.960 INFO:teuthology.orchestra.run.smithi013.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-02-05T20:23:27.960 INFO:teuthology.orchestra.run.smithi013.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-02-05T20:23:27.960 INFO:teuthology.orchestra.run.smithi013.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-02-05T20:23:27.960 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_CODENAME=bionic 2020-02-05T20:23:27.960 INFO:teuthology.orchestra.run.smithi013.stdout:UBUNTU_CODENAME=bionic 2020-02-05T20:23:27.960 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server 2020-02-05T20:23:27.974 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-02-05T20:23:28.045 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-02-05T20:23:28.054 INFO:teuthology.task.internal:Checking for old test directory... 2020-02-05T20:23:28.054 INFO:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2020-02-05T20:23:28.057 INFO:teuthology.orchestra.run.smithi013:> test '!' -e /home/ubuntu/cephtest 2020-02-05T20:23:28.059 INFO:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2020-02-05T20:23:28.064 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-02-05T20:23:28.074 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-02-05T20:23:28.074 INFO:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2020-02-05T20:23:28.104 INFO:teuthology.orchestra.run.smithi013:> test -z $(ls -A /var/lib/ceph) 2020-02-05T20:23:28.107 INFO:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2020-02-05T20:23:28.127 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-02-05T20:23:28.231 INFO:teuthology.run_tasks:Running task kernel... 2020-02-05T20:23:28.249 DEBUG:teuthology.task.kernel:normalized config {'osd.2': {'sha1': 'distro', 'kdb': True}, 'mds.e': {'sha1': 'distro', 'kdb': True}, 'mds.d': {'sha1': 'distro', 'kdb': True}, 'mds.g': {'sha1': 'distro', 'kdb': True}, 'mds.f': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.c': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'mds.i': {'sha1': 'distro', 'kdb': True}, 'mds.h': {'sha1': 'distro', 'kdb': True}, 'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2020-02-05T20:23:28.249 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-02-05T20:23:28.249 INFO:teuthology.orchestra.run.smithi006:> uname -r 2020-02-05T20:23:28.255 INFO:teuthology.orchestra.run.smithi006.stdout:4.15.0-72-generic 2020-02-05T20:23:28.255 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.15.0-72-generic 2020-02-05T20:23:28.256 INFO:teuthology.orchestra.run.smithi006:> sudo apt-get clean 2020-02-05T20:23:28.365 INFO:teuthology.orchestra.run.smithi006:> sudo apt-get update 2020-02-05T20:23:28.623 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-02-05T20:23:28.643 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-02-05T20:23:28.705 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-02-05T20:23:29.021 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-02-05T20:23:29.042 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [624 kB] 2020-02-05T20:23:29.185 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [846 kB] 2020-02-05T20:23:29.392 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [428 kB] 2020-02-05T20:23:29.428 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [203 kB] 2020-02-05T20:23:29.443 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [20.6 kB] 2020-02-05T20:23:29.444 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [5,872 B] 2020-02-05T20:23:29.444 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [609 kB] 2020-02-05T20:23:29.523 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [637 kB] 2020-02-05T20:23:29.531 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [638 kB] 2020-02-05T20:23:29.559 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [215 kB] 2020-02-05T20:23:29.568 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,328 B] 2020-02-05T20:23:29.568 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,284 B] 2020-02-05T20:23:29.568 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [2,640 B] 2020-02-05T20:23:29.572 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [296 kB] 2020-02-05T20:23:29.621 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [29.6 kB] 2020-02-05T20:23:29.623 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [9,568 B] 2020-02-05T20:23:29.624 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [7,824 B] 2020-02-05T20:23:29.624 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,047 kB] 2020-02-05T20:23:29.687 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,006 kB] 2020-02-05T20:23:29.725 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [323 kB] 2020-02-05T20:23:29.736 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [7,480 B] 2020-02-05T20:23:29.736 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,704 B] 2020-02-05T20:23:29.737 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,576 B] 2020-02-05T20:23:29.737 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,028 B] 2020-02-05T20:23:29.738 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,024 B] 2020-02-05T20:23:29.738 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,900 B] 2020-02-05T20:23:30.497 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 7,242 kB in 2s (3,743 kB/s) 2020-02-05T20:23:31.864 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2020-02-05T20:23:31.910 INFO:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-02-05T20:23:31.994 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2020-02-05T20:23:32.250 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2020-02-05T20:23:32.250 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2020-02-05T20:23:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:E: Unable to locate package linux-image-current-generic 2020-02-05T20:23:32.333 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-02-05T20:23:32.334 INFO:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-02-05T20:23:32.415 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2020-02-05T20:23:32.676 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2020-02-05T20:23:32.677 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2020-02-05T20:23:32.865 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2020-02-05T20:23:32.865 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-4.15.0-76 linux-headers-4.15.0-76-generic 2020-02-05T20:23:32.865 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-generic linux-image-4.15.0-76-generic 2020-02-05T20:23:32.865 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-4.15.0-76-generic linux-modules-extra-4.15.0-76-generic 2020-02-05T20:23:32.867 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2020-02-05T20:23:32.867 INFO:teuthology.orchestra.run.smithi006.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-02-05T20:23:32.867 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2020-02-05T20:23:32.867 INFO:teuthology.orchestra.run.smithi006.stdout: thermald 2020-02-05T20:23:32.901 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2020-02-05T20:23:32.901 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-4.15.0-76 linux-headers-4.15.0-76-generic 2020-02-05T20:23:32.901 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-4.15.0-76-generic linux-modules-4.15.0-76-generic 2020-02-05T20:23:32.901 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-extra-4.15.0-76-generic 2020-02-05T20:23:32.903 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2020-02-05T20:23:32.903 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-generic linux-image-generic 2020-02-05T20:23:33.081 INFO:teuthology.orchestra.run.smithi006.stdout:3 upgraded, 5 newly installed, 0 to remove and 86 not upgraded. 2020-02-05T20:23:33.082 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 65.8 MB of archives. 2020-02-05T20:23:33.082 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 332 MB of additional disk space will be used. 2020-02-05T20:23:33.082 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-76-generic amd64 4.15.0-76.86 [13.0 MB] 2020-02-05T20:23:34.113 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-76-generic amd64 4.15.0-76.86 [7,993 kB] 2020-02-05T20:23:34.300 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-76-generic amd64 4.15.0-76.86 [32.7 MB] 2020-02-05T20:23:35.250 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.76.78 [1,864 B] 2020-02-05T20:23:35.251 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.76.78 [2,388 B] 2020-02-05T20:23:35.251 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-76 all 4.15.0-76.86 [10.9 MB] 2020-02-05T20:23:35.568 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-76-generic amd64 4.15.0-76.86 [1,106 kB] 2020-02-05T20:23:35.588 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.76.78 [2,348 B] 2020-02-05T20:23:36.092 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 65.8 MB in 3s (24.6 MB/s) 2020-02-05T20:23:36.293 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-4.15.0-76-generic. 2020-02-05T20:23:36.329 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2020-02-05T20:23:36.332 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../0-linux-modules-4.15.0-76-generic_4.15.0-76.86_amd64.deb ... 2020-02-05T20:23:36.379 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-4.15.0-76-generic (4.15.0-76.86) ... 2020-02-05T20:23:37.980 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-image-4.15.0-76-generic. 2020-02-05T20:23:37.992 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../1-linux-image-4.15.0-76-generic_4.15.0-76.86_amd64.deb ... 2020-02-05T20:23:38.084 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-4.15.0-76-generic (4.15.0-76.86) ... 2020-02-05T20:23:38.592 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-76-generic. 2020-02-05T20:23:38.603 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-76-generic_4.15.0-76.86_amd64.deb ... 2020-02-05T20:23:38.641 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-extra-4.15.0-76-generic (4.15.0-76.86) ... 2020-02-05T20:23:42.392 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../3-linux-generic_4.15.0.76.78_amd64.deb ... 2020-02-05T20:23:42.521 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-generic (4.15.0.76.78) over (4.15.0.72.74) ... 2020-02-05T20:23:42.820 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.76.78_amd64.deb ... 2020-02-05T20:23:42.949 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-generic (4.15.0.76.78) over (4.15.0.72.74) ... 2020-02-05T20:23:43.302 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-4.15.0-76. 2020-02-05T20:23:43.314 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../5-linux-headers-4.15.0-76_4.15.0-76.86_all.deb ... 2020-02-05T20:23:43.352 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-4.15.0-76 (4.15.0-76.86) ... 2020-02-05T20:23:48.283 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-4.15.0-76-generic. 2020-02-05T20:23:48.304 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../6-linux-headers-4.15.0-76-generic_4.15.0-76.86_amd64.deb ... 2020-02-05T20:23:48.333 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-4.15.0-76-generic (4.15.0-76.86) ... 2020-02-05T20:23:50.847 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.76.78_amd64.deb ... 2020-02-05T20:23:50.969 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-generic (4.15.0.76.78) over (4.15.0.72.74) ... 2020-02-05T20:23:51.330 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-4.15.0-76-generic (4.15.0-76.86) ... 2020-02-05T20:23:51.875 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-4.15.0-76-generic (4.15.0-76.86) ... 2020-02-05T20:23:52.326 INFO:teuthology.orchestra.run.smithi006.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-76-generic 2020-02-05T20:23:52.326 INFO:teuthology.orchestra.run.smithi006.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-76-generic 2020-02-05T20:23:52.485 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-4.15.0-76 (4.15.0-76.86) ... 2020-02-05T20:23:52.611 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-4.15.0-76-generic (4.15.0-76.86) ... 2020-02-05T20:23:52.737 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-extra-4.15.0-76-generic (4.15.0-76.86) ... 2020-02-05T20:23:53.280 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-generic (4.15.0.76.78) ... 2020-02-05T20:23:53.406 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-generic (4.15.0.76.78) ... 2020-02-05T20:23:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-generic (4.15.0.76.78) ... 2020-02-05T20:23:53.609 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for linux-image-4.15.0-76-generic (4.15.0-76.86) ... 2020-02-05T20:23:53.794 INFO:teuthology.orchestra.run.smithi006.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-02-05T20:23:53.794 INFO:teuthology.orchestra.run.smithi006.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-76-generic 2020-02-05T20:24:04.914 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-02-05T20:24:04.914 DEBUG:teuthology.task.console_log:Killing console logger for smithi133 2020-02-05T20:24:04.915 DEBUG:teuthology.task.console_log:Killing console logger for smithi006 2020-02-05T20:24:04.915 DEBUG:teuthology.task.console_log:Killing console logger for smithi013 2020-02-05T20:24:04.915 DEBUG:teuthology.task.console_log:Killing console logger for smithi133 2020-02-05T20:24:04.916 DEBUG:teuthology.task.console_log:Killing console logger for smithi006 2020-02-05T20:24:04.916 DEBUG:teuthology.task.console_log:Killing console logger for smithi013 2020-02-05T20:24:04.916 DEBUG:teuthology.exit:Finished running handlers