2021-04-09T19:01:51.164 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-09T19:01:51.166 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_latest} tasks/mds-flush} --archive /home/teuthworker/archive/yuriw-2021-04-09_18:37:20-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6033006 --name yuriw-2021-04-09_18:37:20-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2021-04-09_18:37:20-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6033006/orig.config.yaml 2021-04-09T19:01:51.214 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-04-09T19:01:51.271 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-04-09_18:37:20-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6033006 branch: wip-yuri2-testing-2021-04-09-0846-nautilus description: fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_latest} tasks/mds-flush} email: ceph-qa@ceph.io first_in_suite: false job_id: '6033006' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2021-04-09_18:37:20-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '7.8' overrides: admin_socket: branch: wip-yuri2-testing-2021-04-09-0846-nautilus ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(TOO_FEW_PGS\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2021-04-09-0846-nautilus sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.1 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - client.2 - client.3 sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b sleep_before_teardown: 0 suite: fs suite_branch: wip-yuri2-testing-2021-04-09-0846-nautilus suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b targets: smithi120.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0dCZam2q2vVdAm44km59um+p/GmVZ4C4GmnwNGE3Xlsw4b+xrO+/1RYb6UintxpujLaw0+cR0+yvvViImJAhvShgRZj3wUgMhJ+Ju+PWt7EqgAqukcK8Gqm9kzNt4ER5sm4xTFZD5THCR3cg6WRVeSqs+MtnIk/W2liq1QgU3D9JWFm3eVpi2nsSBfWepW96XCwhYTYuOI1jgzc22GR4jkLy5BqmjLTP6vf23Q/29Caxdo453g/LE7u2hioJ4zp+sd88Dm/IdsfFOnP8mYBhwAtLtGalpO+g23aLbbE+jLNPC49MvUNsVxgoa9eAPpv86vpEHWkoK6b1P5U1KYdwR smithi161.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmgoGlynyeiwYHq3YYftBtTqWOmmCuxwny4pQinCdqXbMv3hO6dKJupDdSnS/9kmH+kUv8b8P1Zek/zXKCAfWCVEF/9xKXzIFSL7gR3DZBLzzu31Mxsstk6kN2Sdahng0Q6WeuUfbs7LwYKfrwUGtt8e1M7+v/P2SCaqxqk+G4dDUUcZX2ScP66GAty2BmrkscXZ1wzupM1GpAObbYy7apbaXhVdSyu++FGJBZz2vgjCL4Lbi0itkz4+jr8yJxXXfTxgeZmWWfsuUtJnvWL5Bo6asdWf7j3IBOwohy+D57oEE+FSAOGwvepNczX5ag+50pZXTmixN0uG+AST/KXhbf tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_flush teuthology_branch: master teuthology_sha1: 85d61eae4759f46ce21e9a37cd816a7a1a66c9d5 timestamp: 2021-04-09_18:37:20 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23935 2021-04-09T19:01:51.271 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa; will attempt to use it 2021-04-09T19:01:51.272 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d23cd2d5f486487b0b80655c4e33344f0f97b82b/qa/tasks 2021-04-09T19:01:51.272 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-04-09T19:01:51.274 INFO:teuthology.task.internal:Checking packages... 2021-04-09T19:01:51.295 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'd23cd2d5f486487b0b80655c4e33344f0f97b82b' 2021-04-09T19:01:51.295 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-04-09T19:01:51.296 INFO:teuthology.packaging:ref: None 2021-04-09T19:01:51.296 INFO:teuthology.packaging:tag: None 2021-04-09T19:01:51.297 INFO:teuthology.packaging:branch: wip-yuri2-testing-2021-04-09-0846-nautilus 2021-04-09T19:01:51.297 INFO:teuthology.packaging:sha1: d23cd2d5f486487b0b80655c4e33344f0f97b82b 2021-04-09T19:01:51.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-yuri2-testing-2021-04-09-0846-nautilus 2021-04-09T19:01:51.489 INFO:teuthology.task.internal:Found packages for ceph version 14.2.19-116.gd23cd2d5 2021-04-09T19:01:51.489 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-04-09T19:01:51.500 INFO:teuthology.task.internal:no buildpackages task found 2021-04-09T19:01:51.500 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-04-09T19:01:51.543 INFO:teuthology.task.internal:Saving configuration 2021-04-09T19:01:51.559 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-04-09T19:01:51.584 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-09T19:01:51.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-04-09 18:56:58.334745', 'description': '/home/teuthworker/archive/yuriw-2021-04-09_18:37:20-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6033006', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMw1gzCMjG1kh0mmf4jrWf84TH7A963nMow6PvVUOkCfD3E4PyaqTvSI5Yal/Va9uZ6/H56gB1u7QKOdfsuWzvQ=', 'os_version': '7', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi120.front.sepia.ceph.com'} 2021-04-09T19:01:51.633 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-04-09 18:56:58.334726', 'description': '/home/teuthworker/archive/yuriw-2021-04-09_18:37:20-fs-wip-yuri2-testing-2021-04-09-0846-nautilus-distro-basic-smithi/6033006', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVCjEdG39scWNp6UcaQN6ooAPkWOAYEnfIycaUTUk+EHUucb8j7m9H/U3YprYHrJOLpeHulondapCB08Jb5Hw4=', 'os_version': '7', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi161.front.sepia.ceph.com'} 2021-04-09T19:01:51.633 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-04-09T19:01:51.644 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'] 2021-04-09T19:01:51.645 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3'] 2021-04-09T19:01:51.645 INFO:teuthology.run_tasks:Running task console_log... 2021-04-09T19:01:51.748 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd04d150c80>, signals=[15]) 2021-04-09T19:01:51.750 INFO:teuthology.run_tasks:Running task internal.connect... 2021-04-09T19:01:51.761 INFO:teuthology.task.internal:Opening connections... 2021-04-09T19:01:51.761 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:01:51.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:01:51.864 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2021-04-09T19:01:51.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:01:51.967 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-04-09T19:01:51.978 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2021-04-09T19:01:52.178 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2021-04-09T19:01:52.179 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2021-04-09T19:01:52.241 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Linux" 2021-04-09T19:01:52.241 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="7 (Core)" 2021-04-09T19:01:52.242 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2021-04-09T19:01:52.242 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2021-04-09T19:01:52.242 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="7" 2021-04-09T19:01:52.242 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2021-04-09T19:01:52.243 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2021-04-09T19:01:52.243 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2021-04-09T19:01:52.243 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.centos.org/" 2021-04-09T19:01:52.243 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-04-09T19:01:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:01:52.244 INFO:teuthology.orchestra.run.smithi120.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2021-04-09T19:01:52.244 INFO:teuthology.orchestra.run.smithi120.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2021-04-09T19:01:52.244 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-04-09T19:01:52.244 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2021-04-09T19:01:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:01:52.245 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2021-04-09T19:01:52.263 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2021-04-09T19:01:52.385 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2021-04-09T19:01:52.385 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2021-04-09T19:01:52.455 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Linux" 2021-04-09T19:01:52.456 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="7 (Core)" 2021-04-09T19:01:52.456 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2021-04-09T19:01:52.456 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2021-04-09T19:01:52.456 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="7" 2021-04-09T19:01:52.457 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2021-04-09T19:01:52.457 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2021-04-09T19:01:52.457 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2021-04-09T19:01:52.457 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.centos.org/" 2021-04-09T19:01:52.458 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-04-09T19:01:52.458 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:01:52.458 INFO:teuthology.orchestra.run.smithi161.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2021-04-09T19:01:52.458 INFO:teuthology.orchestra.run.smithi161.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2021-04-09T19:01:52.459 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-04-09T19:01:52.459 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2021-04-09T19:01:52.459 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:01:52.460 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2021-04-09T19:01:52.475 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-04-09T19:01:52.486 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-04-09T19:01:52.543 INFO:teuthology.task.internal:Checking for old test directory... 2021-04-09T19:01:52.543 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2021-04-09T19:01:52.547 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2021-04-09T19:01:52.633 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-04-09T19:01:52.642 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-04-09T19:01:52.643 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2021-04-09T19:01:52.647 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2021-04-09T19:01:52.741 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-04-09T19:01:52.788 INFO:teuthology.run_tasks:Running task kernel... 2021-04-09T19:01:52.807 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}, 'client.3': {'kdb': True, 'sha1': 'distro'}} 2021-04-09T19:01:52.808 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-04-09T19:01:52.809 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2021-04-09T19:01:52.896 INFO:teuthology.orchestra.run.smithi120.stdout:3.10.0-1127.el7.x86_64 2021-04-09T19:01:52.896 INFO:teuthology.task.kernel:Running kernel on smithi120: 3.10.0-1127.el7.x86_64 2021-04-09T19:01:52.897 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2021-04-09T19:01:54.434 INFO:teuthology.orchestra.run.smithi120.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T19:01:54.434 INFO:teuthology.orchestra.run.smithi120.stdout: : disabled-repos, subscription-manager 2021-04-09T19:01:54.496 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:01:54.497 INFO:teuthology.orchestra.run.smithi120.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2021-04-09T19:01:54.497 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:01:54.641 INFO:teuthology.orchestra.run.smithi120.stdout:Determining fastest mirrors 2021-04-09T19:01:55.401 INFO:teuthology.orchestra.run.smithi120.stdout: * base: mirrors.tripadvisor.com 2021-04-09T19:01:55.414 INFO:teuthology.orchestra.run.smithi120.stdout: * epel: download-cc-rdu01.fedoraproject.org 2021-04-09T19:01:55.414 INFO:teuthology.orchestra.run.smithi120.stdout: * extras: mirror.cs.pitt.edu 2021-04-09T19:01:55.415 INFO:teuthology.orchestra.run.smithi120.stdout: * updates: mirrors.greenmountainaccess.net 2021-04-09T19:01:55.983 INFO:teuthology.orchestra.run.smithi120.stderr:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8378b4bfe11a759a7ce1cf7e1c9bb7b96ed464e5b8cda7760b2bb1d514bace80-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found 2021-04-09T19:01:55.984 INFO:teuthology.orchestra.run.smithi120.stderr:Trying other mirror. 2021-04-09T19:01:55.984 INFO:teuthology.orchestra.run.smithi120.stderr:To address this issue please refer to the below wiki article 2021-04-09T19:01:55.985 INFO:teuthology.orchestra.run.smithi120.stderr: 2021-04-09T19:01:55.985 INFO:teuthology.orchestra.run.smithi120.stderr:https://wiki.centos.org/yum-errors 2021-04-09T19:01:55.985 INFO:teuthology.orchestra.run.smithi120.stderr: 2021-04-09T19:01:55.985 INFO:teuthology.orchestra.run.smithi120.stderr:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2021-04-09T19:01:55.986 INFO:teuthology.orchestra.run.smithi120.stderr: 2021-04-09T19:01:55.990 INFO:teuthology.orchestra.run.smithi120.stderr:http://download-ib01.fedoraproject.org/pub/epel/7/x86_64/repodata/241b734b55c28cde35513fb5e022741ba48ca083ff23e90b9578db10410d3b61-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2021-04-09T19:01:55.990 INFO:teuthology.orchestra.run.smithi120.stderr:Trying other mirror. 2021-04-09T19:01:59.375 INFO:teuthology.orchestra.run.smithi120.stdout:Resolving Dependencies 2021-04-09T19:01:59.376 INFO:teuthology.orchestra.run.smithi120.stdout:--> Running transaction check 2021-04-09T19:01:59.376 INFO:teuthology.orchestra.run.smithi120.stdout:---> Package kernel.x86_64 0:3.10.0-1160.21.1.el7 will be installed 2021-04-09T19:02:00.687 INFO:teuthology.orchestra.run.smithi120.stdout:--> Finished Dependency Resolution 2021-04-09T19:02:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:02:01.544 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies Resolved 2021-04-09T19:02:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:02:01.545 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2021-04-09T19:02:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2021-04-09T19:02:01.545 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2021-04-09T19:02:01.546 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2021-04-09T19:02:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 3.10.0-1160.21.1.el7 updates 50 M 2021-04-09T19:02:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:02:01.546 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2021-04-09T19:02:01.546 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2021-04-09T19:02:01.547 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2021-04-09T19:02:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:02:01.548 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 50 M 2021-04-09T19:02:01.548 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 64 M 2021-04-09T19:02:01.548 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading packages: 2021-04-09T19:02:01.550 INFO:teuthology.orchestra.run.smithi120.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2021-04-09T19:02:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2021-04-09T19:02:03.812 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2021-04-09T19:02:04.543 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded 2021-04-09T19:02:04.544 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2021-04-09T19:02:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-3.10.0-1160.21.1.el7.x86_64 1/1 2021-04-09T19:02:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-3.10.0-1160.21.1.el7.x86_64 1/1 2021-04-09T19:02:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:02:47.958 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2021-04-09T19:02:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: kernel.x86_64 0:3.10.0-1160.21.1.el7 2021-04-09T19:02:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:02:47.959 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2021-04-09T19:02:48.024 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel --last | head -n 1 2021-04-09T19:02:48.393 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-3.10.0-1160.21.1.el7.x86_64 Fri 09 Apr 2021 07:02:07 PM UTC 2021-04-09T19:02:48.396 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:02:48.396 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1127.el7.x86_64 Expected: 3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:02:48.396 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2021-04-09T19:02:48.509 INFO:teuthology.orchestra.run.smithi161.stdout:3.10.0-1127.el7.x86_64 2021-04-09T19:02:48.509 INFO:teuthology.task.kernel:Running kernel on smithi161: 3.10.0-1127.el7.x86_64 2021-04-09T19:02:48.510 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y kernel 2021-04-09T19:02:50.034 INFO:teuthology.orchestra.run.smithi161.stdout:Loaded plugins: fastestmirror, langpacks, priorities, product-id, search- 2021-04-09T19:02:50.034 INFO:teuthology.orchestra.run.smithi161.stdout: : disabled-repos, subscription-manager 2021-04-09T19:02:50.095 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:02:50.096 INFO:teuthology.orchestra.run.smithi161.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2021-04-09T19:02:50.096 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:02:50.229 INFO:teuthology.orchestra.run.smithi161.stdout:Determining fastest mirrors 2021-04-09T19:02:53.801 INFO:teuthology.orchestra.run.smithi161.stdout: * base: mirrors.tripadvisor.com 2021-04-09T19:02:53.812 INFO:teuthology.orchestra.run.smithi161.stdout: * epel: download-cc-rdu01.fedoraproject.org 2021-04-09T19:02:53.812 INFO:teuthology.orchestra.run.smithi161.stdout: * extras: atl.mirrors.clouvider.net 2021-04-09T19:02:53.813 INFO:teuthology.orchestra.run.smithi161.stdout: * updates: mirror.wdc1.us.leaseweb.net 2021-04-09T19:02:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8378b4bfe11a759a7ce1cf7e1c9bb7b96ed464e5b8cda7760b2bb1d514bace80-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found 2021-04-09T19:02:54.331 INFO:teuthology.orchestra.run.smithi161.stderr:Trying other mirror. 2021-04-09T19:02:54.331 INFO:teuthology.orchestra.run.smithi161.stderr:To address this issue please refer to the below wiki article 2021-04-09T19:02:54.332 INFO:teuthology.orchestra.run.smithi161.stderr: 2021-04-09T19:02:54.332 INFO:teuthology.orchestra.run.smithi161.stderr:https://wiki.centos.org/yum-errors 2021-04-09T19:02:54.333 INFO:teuthology.orchestra.run.smithi161.stderr: 2021-04-09T19:02:54.333 INFO:teuthology.orchestra.run.smithi161.stderr:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2021-04-09T19:02:54.334 INFO:teuthology.orchestra.run.smithi161.stderr: 2021-04-09T19:02:54.390 INFO:teuthology.orchestra.run.smithi161.stderr:http://download-ib01.fedoraproject.org/pub/epel/7/x86_64/repodata/241b734b55c28cde35513fb5e022741ba48ca083ff23e90b9578db10410d3b61-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2021-04-09T19:02:54.392 INFO:teuthology.orchestra.run.smithi161.stderr:Trying other mirror. 2021-04-09T19:02:58.151 INFO:teuthology.orchestra.run.smithi161.stdout:Resolving Dependencies 2021-04-09T19:02:58.152 INFO:teuthology.orchestra.run.smithi161.stdout:--> Running transaction check 2021-04-09T19:02:58.152 INFO:teuthology.orchestra.run.smithi161.stdout:---> Package kernel.x86_64 0:3.10.0-1160.21.1.el7 will be installed 2021-04-09T19:02:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:--> Finished Dependency Resolution 2021-04-09T19:03:00.210 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:03:00.211 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies Resolved 2021-04-09T19:03:00.224 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:03:00.225 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2021-04-09T19:03:00.225 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2021-04-09T19:03:00.225 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2021-04-09T19:03:00.226 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2021-04-09T19:03:00.226 INFO:teuthology.orchestra.run.smithi161.stdout: kernel x86_64 3.10.0-1160.21.1.el7 updates 50 M 2021-04-09T19:03:00.226 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:03:00.226 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2021-04-09T19:03:00.227 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2021-04-09T19:03:00.227 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2021-04-09T19:03:00.227 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:03:00.227 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 50 M 2021-04-09T19:03:00.227 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 64 M 2021-04-09T19:03:00.228 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading packages: 2021-04-09T19:03:00.235 INFO:teuthology.orchestra.run.smithi161.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2021-04-09T19:03:01.263 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2021-04-09T19:03:01.395 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2021-04-09T19:03:02.147 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded 2021-04-09T19:03:02.148 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2021-04-09T19:03:44.703 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-3.10.0-1160.21.1.el7.x86_64 1/1 2021-04-09T19:03:45.794 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-3.10.0-1160.21.1.el7.x86_64 1/1 2021-04-09T19:03:45.794 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:03:45.794 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2021-04-09T19:03:45.794 INFO:teuthology.orchestra.run.smithi161.stdout: kernel.x86_64 0:3.10.0-1160.21.1.el7 2021-04-09T19:03:45.795 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:03:45.795 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2021-04-09T19:03:45.853 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel --last | head -n 1 2021-04-09T19:03:46.205 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-3.10.0-1160.21.1.el7.x86_64 Fri 09 Apr 2021 07:03:04 PM UTC 2021-04-09T19:03:46.208 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:03:46.208 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1127.el7.x86_64 Expected: 3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:03:46.208 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-04-09T19:03:46.209 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-04-09T19:03:46.209 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-04-09T19:03:46.209 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-04-09T19:03:46.210 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2021-04-09T19:03:46.210 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel --last | head -n 1 2021-04-09T19:03:46.525 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-3.10.0-1160.21.1.el7.x86_64 Fri 09 Apr 2021 07:02:07 PM UTC 2021-04-09T19:03:46.527 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:03:46.527 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2021-04-09T19:03:46.676 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2021-04-09T19:03:46.676 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2021-04-09T19:03:46.677 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.02 2021-04-09T19:03:46.677 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 0.81.el7.centos 2021-04-09T19:03:46.677 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2021-04-09T19:03:46.677 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Thu 30 Apr 2020 08:13:52 PM UTC 2021-04-09T19:03:46.677 INFO:teuthology.orchestra.run.smithi120.stdout:Group : System Environment/Base 2021-04-09T19:03:46.678 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 10079533 2021-04-09T19:03:46.678 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2021-04-09T19:03:46.678 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Fri 03 Apr 2020 08:52:52 PM UTC, Key ID 24c6a8a7f4a80eb5 2021-04-09T19:03:46.678 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.02-0.81.el7.centos.src.rpm 2021-04-09T19:03:46.679 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Fri 03 Apr 2020 05:25:04 PM UTC 2021-04-09T19:03:46.679 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : kbuilder.bsys.centos.org 2021-04-09T19:03:46.679 INFO:teuthology.orchestra.run.smithi120.stdout:Relocations : (not relocatable) 2021-04-09T19:03:46.679 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : CentOS BuildSystem 2021-04-09T19:03:46.680 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2021-04-09T19:03:46.680 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2021-04-09T19:03:46.680 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2021-04-09T19:03:46.680 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2021-04-09T19:03:46.681 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:03:46.681 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-04-09T19:03:46.682 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2021-04-09T19:03:46.682 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2021-04-09T19:03:46.682 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2021-04-09T19:03:46.683 INFO:teuthology.orchestra.run.smithi120.stdout: 2021-04-09T19:03:46.683 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2021-04-09T19:03:46.685 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-04-09T19:03:46.686 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:03:46.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-04-09T19:03:47.161 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2021-04-09T19:03:47.293 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:03:47.317 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initramfs-3.10.0-1160.21.1.el7.x86_64.img 2021-04-09T19:03:47.565 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-3.10.0-1127.el7.x86_64 2021-04-09T19:03:47.589 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initramfs-3.10.0-1127.el7.x86_64.img 2021-04-09T19:03:47.618 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-0-rescue-4c9f242ce0c648a4b56b7033e7858e4f 2021-04-09T19:03:47.628 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initramfs-0-rescue-4c9f242ce0c648a4b56b7033e7858e4f.img 2021-04-09T19:03:48.699 INFO:teuthology.orchestra.run.smithi120.stderr:done 2021-04-09T19:03:48.702 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2021-04-09T19:03:48.771 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.6yt9QOVpTI 2021-04-09T19:03:48.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6yt9QOVpTI 2021-04-09T19:03:48.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.6yt9QOVpTI 2021-04-09T19:03:49.007 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.6yt9QOVpTI is 5KB 2021-04-09T19:03:49.063 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.6yt9QOVpTI 2021-04-09T19:03:49.113 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default 0 2021-04-09T19:03:49.363 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2021-04-09T19:03:49.367 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-04-09T19:03:49.368 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2021-04-09T19:03:49.368 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel --last | head -n 1 2021-04-09T19:03:49.687 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-3.10.0-1160.21.1.el7.x86_64 Fri 09 Apr 2021 07:03:04 PM UTC 2021-04-09T19:03:49.690 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:03:49.690 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2021-04-09T19:03:49.828 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2021-04-09T19:03:49.828 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2021-04-09T19:03:49.829 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.02 2021-04-09T19:03:49.829 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 0.81.el7.centos 2021-04-09T19:03:49.829 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2021-04-09T19:03:49.830 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Thu 30 Apr 2020 08:13:52 PM UTC 2021-04-09T19:03:49.830 INFO:teuthology.orchestra.run.smithi161.stdout:Group : System Environment/Base 2021-04-09T19:03:49.831 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 10079533 2021-04-09T19:03:49.831 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2021-04-09T19:03:49.831 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Fri 03 Apr 2020 08:52:52 PM UTC, Key ID 24c6a8a7f4a80eb5 2021-04-09T19:03:49.831 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.02-0.81.el7.centos.src.rpm 2021-04-09T19:03:49.832 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Fri 03 Apr 2020 05:25:04 PM UTC 2021-04-09T19:03:49.832 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : kbuilder.bsys.centos.org 2021-04-09T19:03:49.833 INFO:teuthology.orchestra.run.smithi161.stdout:Relocations : (not relocatable) 2021-04-09T19:03:49.833 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : CentOS BuildSystem 2021-04-09T19:03:49.833 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2021-04-09T19:03:49.834 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2021-04-09T19:03:49.834 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2021-04-09T19:03:49.834 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2021-04-09T19:03:49.835 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:03:49.835 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-04-09T19:03:49.835 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2021-04-09T19:03:49.836 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2021-04-09T19:03:49.836 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2021-04-09T19:03:49.836 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-04-09T19:03:49.836 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2021-04-09T19:03:49.837 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-04-09T19:03:49.838 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:03:49.838 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-04-09T19:03:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2021-04-09T19:03:50.356 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-3.10.0-1160.21.1.el7.x86_64 2021-04-09T19:03:50.377 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initramfs-3.10.0-1160.21.1.el7.x86_64.img 2021-04-09T19:03:50.636 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-3.10.0-1127.el7.x86_64 2021-04-09T19:03:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initramfs-3.10.0-1127.el7.x86_64.img 2021-04-09T19:03:50.702 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-0-rescue-4c9f242ce0c648a4b56b7033e7858e4f 2021-04-09T19:03:50.712 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initramfs-0-rescue-4c9f242ce0c648a4b56b7033e7858e4f.img 2021-04-09T19:03:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:done 2021-04-09T19:03:51.835 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2021-04-09T19:03:51.889 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.tJr3mkXxYi 2021-04-09T19:03:51.889 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tJr3mkXxYi 2021-04-09T19:03:51.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.tJr3mkXxYi 2021-04-09T19:03:52.077 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.tJr3mkXxYi is 5KB 2021-04-09T19:03:52.136 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.tJr3mkXxYi 2021-04-09T19:03:52.186 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default 0 2021-04-09T19:03:52.452 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2021-04-09T19:04:22.483 INFO:teuthology.misc:Re-opening connections... 2021-04-09T19:04:22.484 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:04:22.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:04:22.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:04:40.159 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:04:40.161 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-04-09T19:04:40.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:04:40.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:04:58.715 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-04-09T19:04:58.716 DEBUG:teuthology.misc:waited 36.232152700424194 2021-04-09T19:04:59.717 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:04:59.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:04:59.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:05:02.783 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:05:02.784 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-04-09T19:05:02.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:05:02.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:02.846 DEBUG:teuthology.orchestra.remote:timed out 2021-04-09T19:06:02.848 DEBUG:teuthology.misc:waited 100.36395812034607 2021-04-09T19:06:03.849 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:03.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:03.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:06.907 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:06.908 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-04-09T19:06:06.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:06.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:07.023 DEBUG:teuthology.orchestra.run.smithi161:> true 2021-04-09T19:06:07.495 DEBUG:teuthology.misc:waited 105.01156067848206 2021-04-09T19:06:08.497 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:08.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:08.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:09.983 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:09.984 DEBUG:teuthology.misc:waited 107.49999904632568 2021-04-09T19:06:10.985 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:10.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:10.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:13.051 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:13.052 DEBUG:teuthology.misc:waited 110.56801795959473 2021-04-09T19:06:14.052 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:14.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:14.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:16.123 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:16.124 DEBUG:teuthology.misc:waited 113.64004516601562 2021-04-09T19:06:17.125 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:17.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:17.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:19.195 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:19.196 DEBUG:teuthology.misc:waited 116.71201944351196 2021-04-09T19:06:20.196 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:20.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:20.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:22.267 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:22.268 DEBUG:teuthology.misc:waited 119.78445720672607 2021-04-09T19:06:23.270 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:23.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:23.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:25.339 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:25.340 DEBUG:teuthology.misc:waited 122.85601234436035 2021-04-09T19:06:26.341 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:26.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:26.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:28.415 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:28.416 DEBUG:teuthology.misc:waited 125.93200135231018 2021-04-09T19:06:29.417 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:29.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:29.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:31.483 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:31.484 DEBUG:teuthology.misc:waited 129.0000605583191 2021-04-09T19:06:32.484 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:32.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:32.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:34.559 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:34.560 DEBUG:teuthology.misc:waited 132.07610511779785 2021-04-09T19:06:35.560 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:35.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:35.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:37.627 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:37.628 DEBUG:teuthology.misc:waited 135.1439745426178 2021-04-09T19:06:38.629 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:38.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:38.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:40.699 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:40.700 DEBUG:teuthology.misc:waited 138.21600770950317 2021-04-09T19:06:41.701 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:41.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:41.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:43.771 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:43.772 DEBUG:teuthology.misc:waited 141.28801727294922 2021-04-09T19:06:44.773 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:44.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:44.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:46.843 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:46.844 DEBUG:teuthology.misc:waited 144.36017274856567 2021-04-09T19:06:47.844 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:47.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:47.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:49.915 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:49.916 DEBUG:teuthology.misc:waited 147.43208694458008 2021-04-09T19:06:50.917 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:50.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:50.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:52.987 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:52.988 DEBUG:teuthology.misc:waited 150.5040225982666 2021-04-09T19:06:53.988 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:53.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:53.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:56.063 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:56.064 DEBUG:teuthology.misc:waited 153.58044409751892 2021-04-09T19:06:57.065 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:06:57.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:06:57.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:06:59.135 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:06:59.136 DEBUG:teuthology.misc:waited 156.65197110176086 2021-04-09T19:07:00.137 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:00.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:00.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:02.207 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:02.208 DEBUG:teuthology.misc:waited 159.7240080833435 2021-04-09T19:07:03.209 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:03.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:03.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:05.275 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:05.276 DEBUG:teuthology.misc:waited 162.7919774055481 2021-04-09T19:07:06.277 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:06.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:06.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:08.347 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:08.348 DEBUG:teuthology.misc:waited 165.86423683166504 2021-04-09T19:07:09.349 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:09.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:09.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:11.419 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:11.420 DEBUG:teuthology.misc:waited 168.93603491783142 2021-04-09T19:07:12.421 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:12.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:12.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:14.491 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:14.492 DEBUG:teuthology.misc:waited 172.00800585746765 2021-04-09T19:07:15.493 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:15.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:15.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:17.567 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:17.568 DEBUG:teuthology.misc:waited 175.08402681350708 2021-04-09T19:07:18.569 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:18.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:18.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:20.635 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:20.636 DEBUG:teuthology.misc:waited 178.1520233154297 2021-04-09T19:07:21.637 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:21.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:21.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:23.707 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:23.708 DEBUG:teuthology.misc:waited 181.22401022911072 2021-04-09T19:07:24.709 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:24.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:24.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:26.779 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:26.780 DEBUG:teuthology.misc:waited 184.29594135284424 2021-04-09T19:07:27.781 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:27.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:27.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:29.852 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:29.853 DEBUG:teuthology.misc:waited 187.36906003952026 2021-04-09T19:07:30.854 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:30.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:30.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:32.927 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:32.928 DEBUG:teuthology.misc:waited 190.444162607193 2021-04-09T19:07:33.929 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:33.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:33.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:35.995 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:35.996 DEBUG:teuthology.misc:waited 193.51218581199646 2021-04-09T19:07:36.997 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:36.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:36.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:39.067 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:39.068 DEBUG:teuthology.misc:waited 196.58437037467957 2021-04-09T19:07:40.069 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:40.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:40.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:42.139 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:42.140 DEBUG:teuthology.misc:waited 199.65601921081543 2021-04-09T19:07:43.141 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:43.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:43.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:45.211 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:45.212 DEBUG:teuthology.misc:waited 202.72835540771484 2021-04-09T19:07:46.213 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:46.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:46.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:48.283 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:48.284 DEBUG:teuthology.misc:waited 205.80005049705505 2021-04-09T19:07:49.285 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:49.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:49.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:51.355 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:51.356 DEBUG:teuthology.misc:waited 208.8722903728485 2021-04-09T19:07:52.357 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:52.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:52.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:54.431 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:54.432 DEBUG:teuthology.misc:waited 211.94815063476562 2021-04-09T19:07:55.432 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:55.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:55.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:07:57.503 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:07:57.504 DEBUG:teuthology.misc:waited 215.02002573013306 2021-04-09T19:07:58.505 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:07:58.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:07:58.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:00.575 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:00.576 DEBUG:teuthology.misc:waited 218.09210801124573 2021-04-09T19:08:01.577 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:01.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:01.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:03.643 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:03.644 DEBUG:teuthology.misc:waited 221.16000747680664 2021-04-09T19:08:04.645 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:04.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:04.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:06.715 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:06.716 DEBUG:teuthology.misc:waited 224.23228931427002 2021-04-09T19:08:07.718 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:07.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:07.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:09.791 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:09.792 DEBUG:teuthology.misc:waited 227.30798411369324 2021-04-09T19:08:10.792 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:10.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:10.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:12.859 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:12.860 DEBUG:teuthology.misc:waited 230.37623810768127 2021-04-09T19:08:13.860 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:13.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:13.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:15.931 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:15.932 DEBUG:teuthology.misc:waited 233.44826006889343 2021-04-09T19:08:16.934 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:16.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:16.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:19.007 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:19.008 DEBUG:teuthology.misc:waited 236.52432942390442 2021-04-09T19:08:20.009 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:20.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:20.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:22.075 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:22.076 DEBUG:teuthology.misc:waited 239.59190368652344 2021-04-09T19:08:23.076 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:23.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:23.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:25.147 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:25.148 DEBUG:teuthology.misc:waited 242.6643888950348 2021-04-09T19:08:26.149 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:26.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:26.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:28.219 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:28.220 DEBUG:teuthology.misc:waited 245.7359619140625 2021-04-09T19:08:29.220 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:29.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:29.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:31.291 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:31.292 DEBUG:teuthology.misc:waited 248.80797386169434 2021-04-09T19:08:32.293 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:32.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:32.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:34.367 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:34.368 DEBUG:teuthology.misc:waited 251.88396215438843 2021-04-09T19:08:35.368 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:35.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:35.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:37.435 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:37.436 DEBUG:teuthology.misc:waited 254.9522979259491 2021-04-09T19:08:38.437 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:38.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:38.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:40.511 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:40.512 DEBUG:teuthology.misc:waited 258.0281901359558 2021-04-09T19:08:41.512 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:41.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:41.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:43.579 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:43.580 DEBUG:teuthology.misc:waited 261.09606862068176 2021-04-09T19:08:44.580 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:44.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:44.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:46.652 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:46.653 DEBUG:teuthology.misc:waited 264.16901755332947 2021-04-09T19:08:47.653 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:47.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:47.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:49.723 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:49.724 DEBUG:teuthology.misc:waited 267.2402536869049 2021-04-09T19:08:50.725 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:50.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:50.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:52.799 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:52.800 DEBUG:teuthology.misc:waited 270.31607151031494 2021-04-09T19:08:53.800 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:53.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:53.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:55.867 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:55.868 DEBUG:teuthology.misc:waited 273.38399267196655 2021-04-09T19:08:56.869 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:56.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:56.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:08:58.939 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:08:58.940 DEBUG:teuthology.misc:waited 276.456013917923 2021-04-09T19:08:59.941 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:08:59.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:08:59.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:09:02.011 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:09:02.012 DEBUG:teuthology.misc:waited 279.5281767845154 2021-04-09T19:09:03.013 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:09:03.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:09:03.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:09:05.083 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:09:05.084 DEBUG:teuthology.misc:waited 282.60004806518555 2021-04-09T19:09:06.085 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:09:06.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:09:06.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:09:08.155 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:09:08.156 DEBUG:teuthology.misc:waited 285.6719923019409 2021-04-09T19:09:09.157 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:09:09.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:09:09.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:09:11.231 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:09:11.232 DEBUG:teuthology.misc:waited 288.7479431629181 2021-04-09T19:09:12.233 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:09:12.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:09:12.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:09:14.303 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:09:14.304 DEBUG:teuthology.misc:waited 291.82008624076843 2021-04-09T19:09:15.305 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:09:15.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:09:15.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:09:17.375 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:09:17.376 DEBUG:teuthology.misc:waited 294.89209270477295 2021-04-09T19:09:18.377 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:09:18.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:09:18.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:09:20.444 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:09:20.444 DEBUG:teuthology.misc:waited 297.9605679512024 2021-04-09T19:09:21.445 INFO:teuthology.misc:trying to connect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:09:21.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-09T19:09:21.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-04-09T19:09:23.516 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2021-04-09T19:09:23.516 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/task/kernel.py", line 1340, in task wait_for_reboot(ctx, need_version, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/task/kernel.py", line 695, in wait_for_reboot teuthology.reconnect(ctx, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/misc.py", line 934, in reconnect remote.name) RuntimeError: Could not reconnect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:09:23.620 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=da497c282f4a4dbfa15b55f22cd5ae92 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/task/kernel.py", line 1340, in task wait_for_reboot(ctx, need_version, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/task/kernel.py", line 695, in wait_for_reboot teuthology.reconnect(ctx, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/misc.py", line 934, in reconnect remote.name) RuntimeError: Could not reconnect to ubuntu@smithi120.front.sepia.ceph.com 2021-04-09T19:09:23.622 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2021-04-09T19:09:23.678 INFO:teuthology.nuke:Checking targets against current locks 2021-04-09T19:09:23.768 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/run.py", line 412, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/run.py", line 269, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable