2021-03-30T00:17:00.907 INFO:root:teuthology version: 1.1.0-9870012c 2021-03-30T00:17:00.910 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/sage-2021-03-29_23:03:30-rados-wip-sage4-testing-2021-03-29-1356-octopus-distro-basic-smithi/6010450 --name sage-2021-03-29_23:03:30-rados-wip-sage4-testing-2021-03-29-1356-octopus-distro-basic-smithi --verbose --description rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} --owner scheduled_sage@teuthology -- /home/teuthworker/archive/sage-2021-03-29_23:03:30-rados-wip-sage4-testing-2021-03-29-1356-octopus-distro-basic-smithi/6010450/orig.config.yaml 2021-03-30T00:17:00.949 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-30T00:17:01.010 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-03-29_23:03:30-rados-wip-sage4-testing-2021-03-29-1356-octopus-distro-basic-smithi/6010450 branch: wip-sage4-testing-2021-03-29-1356-octopus description: rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} email: null first_in_suite: false job_id: '6010450' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-03-29_23:03:30-rados-wip-sage4-testing-2021-03-29-1356-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-sage4-testing-2021-03-29-1356-octopus ceph: conf: global: mon client directed command retry: 5 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 4a9294109b3f559496c27561de129f2d700071d9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 4a9294109b3f559496c27561de129f2d700071d9 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-sage4-testing-2021-03-29-1356-octopus sha1: 4a9294109b3f559496c27561de129f2d700071d9 owner: scheduled_sage@teuthology priority: 70 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 sha1: 4a9294109b3f559496c27561de129f2d700071d9 sleep_before_teardown: 0 suite: rados suite_branch: wip-sage4-testing-2021-03-29-1356-octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4a9294109b3f559496c27561de129f2d700071d9/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 4a9294109b3f559496c27561de129f2d700071d9 targets: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPwGQ/kKAuqtwZXZ7HsU53DY5iMr8NPi9SIDP7UZ5TIGs5L+iHzpyXGc49kWSKckS3IcbbmrD1nddAbldz7/kua94bVokoiqDLB0AI6GVrmUmR3ceSWTEEn2vKmgcVCWcO4pRFjPm72XfIMlBOCve1yN1tTndi1AuEcqeQodzZ4rtKfo8E/+i9nxqjLiJqMdK0OwUjF3mQBo4iXehAoM8YPHfhgxX3eFtd5HUCoWR2L7+03wbISVsk9VGDBc2w7gzDC9dHrsMoL/zmT6B9f3vShYPoRrNogwz4FdEkeS5d+Ia8P5zfBIZ+g14EN/uNg5fBK8eUBGn111NxAd0A7XQL/G17DJPkOmrQ1EqdT09Ax/uCzEqux2xiOFBtC65EGeTAHpUoip2n2xdAU/j3e19FZyiFlUgeUqKrLE/gi5gpARJcvkJP+GTClF+dNogjr6Zxq61qewnLLEd+OzQ8PjkzWo1aur/Y0kjK8c8sGCSY9eHz13JlheYS7eNB2fIJQXU= smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPvw4mzY2FregIR+owQRxAw5of9iPIXdpplyQ03rmG8s7nk+Aj0iPhlCoo8gWtrLWJ6vAZGhKqV+zAdMhcNfeFSbvGIxyBAOByN+bqXug9CsIUCb+TdbhJ9VCI8Pi2UgZi786yRMMhHE5n+GaqUBBIZ/MfVJpgbxV83+5M5kXU7Tb1aj9AmqPvlWzfBjy8LUZIiEmuS6n7qG1aeEQl6+Z1EOHlMxvneN4IvNspoZxjJm7naQMpenGcmWBspbWM5FHw+71KrxUSkNXOCi6563PMtBlhylt1kfsZZopB8oomJclayAIPG2Iku398n+0DbHvazYeHxdqQHO8loALMnWrqqDAAKp2Zq3DYBKBzRuweEvmfKMp1C7EorUfFACnhhIEc3uTcM5QMopNujS694HRksA1Du6EIuJlsfc1UfKa08fQSWQFodzLRv+tHayLF9XImJWB64ks3NNEZiDchPgfhvu46iKTNhL0YOrhPoUXL+rI2oWZlgNIzLd5ZbzJ1abs= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 20 thrash_delay: 1 - rados: clients: - client.0 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology_branch: master teuthology_sha1: 9870012c9b43ad9e4e27984868ce0706e230f04f timestamp: 2021-03-29_23:03:30 tube: smithi user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.16628 2021-03-30T00:17:01.010 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4a9294109b3f559496c27561de129f2d700071d9/qa; will attempt to use it 2021-03-30T00:17:01.013 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4a9294109b3f559496c27561de129f2d700071d9/qa/tasks 2021-03-30T00:17:01.013 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-30T00:17:01.016 INFO:teuthology.task.internal:Checking packages... 2021-03-30T00:17:01.074 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '4a9294109b3f559496c27561de129f2d700071d9' 2021-03-30T00:17:01.074 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-30T00:17:01.075 INFO:teuthology.packaging:ref: None 2021-03-30T00:17:01.075 INFO:teuthology.packaging:tag: None 2021-03-30T00:17:01.076 INFO:teuthology.packaging:branch: wip-sage4-testing-2021-03-29-1356-octopus 2021-03-30T00:17:01.076 INFO:teuthology.packaging:sha1: 4a9294109b3f559496c27561de129f2d700071d9 2021-03-30T00:17:01.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-sage4-testing-2021-03-29-1356-octopus 2021-03-30T00:17:01.221 INFO:teuthology.task.internal:Found packages for ceph version 15.2.10-14.g4a929410 2021-03-30T00:17:01.222 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-30T00:17:01.232 INFO:teuthology.task.internal:no buildpackages task found 2021-03-30T00:17:01.233 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-30T00:17:02.334 INFO:teuthology.task.internal:Saving configuration 2021-03-30T00:17:02.352 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-30T00:17:02.593 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-30T00:17:02.614 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-30 00:11:39.132419', 'description': '/home/teuthworker/archive/sage-2021-03-29_23:03:30-rados-wip-sage4-testing-2021-03-29-1356-octopus-distro-basic-smithi/6010450', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6l1M36tGRzd7iwUdQzcS0ZUqwSrNjUoCKWEZZA6vbbl1pUfX9cBdI45SCkRhWW6NoixGmAW9Jncp8N5hNipco=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi008.front.sepia.ceph.com'} 2021-03-30T00:17:02.638 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-30 00:11:39.132384', 'description': '/home/teuthworker/archive/sage-2021-03-29_23:03:30-rados-wip-sage4-testing-2021-03-29-1356-octopus-distro-basic-smithi/6010450', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKTiIaUs4ybUMSzkDdM4qIlQR/8Jqb2YHrBV90k2iYEYgKlHSYkJLDme+rRTqr8Dq4TsRoSrfrsbjErq8BVHG5Q=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi165.front.sepia.ceph.com'} 2021-03-30T00:17:02.639 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-30T00:17:02.934 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2021-03-30T00:17:02.934 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2021-03-30T00:17:02.935 INFO:teuthology.run_tasks:Running task console_log... 2021-03-30T00:17:03.321 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fea2c713f28>, signals=[15]) 2021-03-30T00:17:03.330 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-30T00:17:03.570 INFO:teuthology.task.internal:Opening connections... 2021-03-30T00:17:03.570 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2021-03-30T00:17:03.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T00:17:03.655 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2021-03-30T00:17:03.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T00:17:03.729 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-30T00:17:04.276 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2021-03-30T00:17:04.297 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2021-03-30T00:17:04.298 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2021-03-30T00:17:04.354 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Linux" 2021-03-30T00:17:04.355 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8 (Core)" 2021-03-30T00:17:04.355 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2021-03-30T00:17:04.356 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2021-03-30T00:17:04.356 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2021-03-30T00:17:04.357 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2021-03-30T00:17:04.357 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-03-30T00:17:04.357 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2021-03-30T00:17:04.358 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-03-30T00:17:04.358 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.centos.org/" 2021-03-30T00:17:04.359 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-03-30T00:17:04.359 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-03-30T00:17:04.359 INFO:teuthology.orchestra.run.smithi008.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-03-30T00:17:04.360 INFO:teuthology.orchestra.run.smithi008.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-03-30T00:17:04.360 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-03-30T00:17:04.361 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-03-30T00:17:04.361 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-03-30T00:17:04.363 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2021-03-30T00:17:04.383 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2021-03-30T00:17:04.400 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2021-03-30T00:17:04.400 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2021-03-30T00:17:04.459 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Linux" 2021-03-30T00:17:04.460 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8 (Core)" 2021-03-30T00:17:04.460 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2021-03-30T00:17:04.461 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2021-03-30T00:17:04.462 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8" 2021-03-30T00:17:04.462 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8" 2021-03-30T00:17:04.465 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-03-30T00:17:04.465 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2021-03-30T00:17:04.465 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-03-30T00:17:04.466 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://www.centos.org/" 2021-03-30T00:17:04.466 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-03-30T00:17:04.466 INFO:teuthology.orchestra.run.smithi165.stdout: 2021-03-30T00:17:04.467 INFO:teuthology.orchestra.run.smithi165.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-03-30T00:17:04.468 INFO:teuthology.orchestra.run.smithi165.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-03-30T00:17:04.469 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-03-30T00:17:04.469 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-03-30T00:17:04.470 INFO:teuthology.orchestra.run.smithi165.stdout: 2021-03-30T00:17:04.471 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2021-03-30T00:17:04.504 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-30T00:17:05.060 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-30T00:17:05.224 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-30T00:17:05.225 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2021-03-30T00:17:05.231 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2021-03-30T00:17:05.249 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-30T00:17:05.380 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-30T00:17:05.381 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2021-03-30T00:17:05.383 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2021-03-30T00:17:05.408 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-30T00:17:05.659 INFO:teuthology.run_tasks:Running task kernel... 2021-03-30T00:17:05.901 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}} 2021-03-30T00:17:05.902 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-30T00:17:05.902 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2021-03-30T00:17:05.920 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-03-30T00:17:05.920 INFO:teuthology.task.kernel:Running kernel on smithi008: 4.18.0-240.10.1.el8_3.x86_64 2021-03-30T00:17:05.920 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum install -y kernel 2021-03-30T00:17:09.362 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-8 - AppStream 21 MB/s | 6.3 MB 00:00 2021-03-30T00:17:10.531 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-8 - Base 24 MB/s | 2.3 MB 00:00 2021-03-30T00:17:11.015 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-8 - Extras 149 kB/s | 9.6 kB 00:00 2021-03-30T00:17:11.640 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 16 MB/s | 9.1 MB 00:00 2021-03-30T00:17:13.675 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2021-03-30T00:17:14.717 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2021-03-30T00:17:14.718 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-240.10.1.el8_3.x86_64 is already installed. 2021-03-30T00:17:14.884 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2021-03-30T00:17:14.904 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2021-03-30T00:17:14.904 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2021-03-30T00:17:14.905 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2021-03-30T00:17:14.905 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2021-03-30T00:17:14.906 INFO:teuthology.orchestra.run.smithi008.stdout: kernel x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 4.3 M 2021-03-30T00:17:14.906 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2021-03-30T00:17:14.907 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-core x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 30 M 2021-03-30T00:17:14.907 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 26 M 2021-03-30T00:17:14.908 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-03-30T00:17:14.908 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2021-03-30T00:17:14.908 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2021-03-30T00:17:14.910 INFO:teuthology.orchestra.run.smithi008.stdout:Install 3 Packages 2021-03-30T00:17:14.911 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-03-30T00:17:14.911 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 60 M 2021-03-30T00:17:14.912 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 83 M 2021-03-30T00:17:14.912 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2021-03-30T00:17:15.003 INFO:teuthology.orchestra.run.smithi008.stdout:(1/3): kernel-4.18.0-240.15.1.el8_3.x86_64.rpm 44 MB/s | 4.3 MB 00:00 2021-03-30T00:17:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:(2/3): kernel-modules-4.18.0-240.15.1.el8_3.x86 34 MB/s | 26 MB 00:00 2021-03-30T00:17:15.854 INFO:teuthology.orchestra.run.smithi008.stdout:(3/3): kernel-core-4.18.0-240.15.1.el8_3.x86_64 32 MB/s | 30 MB 00:00 2021-03-30T00:17:15.857 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2021-03-30T00:17:15.858 INFO:teuthology.orchestra.run.smithi008.stdout:Total 63 MB/s | 60 MB 00:00 2021-03-30T00:17:15.947 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2021-03-30T00:17:16.269 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2021-03-30T00:17:16.270 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2021-03-30T00:17:17.346 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2021-03-30T00:17:17.349 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2021-03-30T00:17:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2021-03-30T00:17:20.343 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-core-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T00:17:23.124 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-core-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T00:17:23.459 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T00:17:26.549 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T00:17:26.737 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T00:17:50.687 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-core-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T00:17:50.956 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T00:17:50.957 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T00:17:50.957 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-core-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T00:17:51.254 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-modules-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T00:17:51.254 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2021-03-30T00:17:51.604 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-03-30T00:17:51.605 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2021-03-30T00:17:51.605 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:17:51.606 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-core-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:17:51.606 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:17:51.607 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-03-30T00:17:51.607 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2021-03-30T00:17:51.682 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel --last | head -n 1 2021-03-30T00:17:51.790 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-240.15.1.el8_3.x86_64 Tue 30 Mar 2021 12:17:26 AM UTC 2021-03-30T00:17:51.792 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:17:51.793 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-240.10.1.el8_3.x86_64 Expected: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:17:51.793 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2021-03-30T00:17:51.812 INFO:teuthology.orchestra.run.smithi165.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-03-30T00:17:51.812 INFO:teuthology.task.kernel:Running kernel on smithi165: 4.18.0-240.10.1.el8_3.x86_64 2021-03-30T00:17:51.813 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum install -y kernel 2021-03-30T00:17:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - AppStream 30 MB/s | 6.3 MB 00:00 2021-03-30T00:17:56.331 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - Base 26 MB/s | 2.3 MB 00:00 2021-03-30T00:17:56.770 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - Extras 149 kB/s | 9.6 kB 00:00 2021-03-30T00:17:57.464 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 14 MB/s | 9.1 MB 00:00 2021-03-30T00:17:59.399 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2021-03-30T00:18:00.514 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2021-03-30T00:18:00.515 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-4.18.0-240.10.1.el8_3.x86_64 is already installed. 2021-03-30T00:18:00.684 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2021-03-30T00:18:00.700 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2021-03-30T00:18:00.700 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2021-03-30T00:18:00.701 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2021-03-30T00:18:00.713 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2021-03-30T00:18:00.713 INFO:teuthology.orchestra.run.smithi165.stdout: kernel x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 4.3 M 2021-03-30T00:18:00.714 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2021-03-30T00:18:00.714 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-core x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 30 M 2021-03-30T00:18:00.715 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules x86_64 4.18.0-240.15.1.el8_3 CentOS-Base 26 M 2021-03-30T00:18:00.715 INFO:teuthology.orchestra.run.smithi165.stdout: 2021-03-30T00:18:00.716 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2021-03-30T00:18:00.716 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2021-03-30T00:18:00.717 INFO:teuthology.orchestra.run.smithi165.stdout:Install 3 Packages 2021-03-30T00:18:00.717 INFO:teuthology.orchestra.run.smithi165.stdout: 2021-03-30T00:18:00.717 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 60 M 2021-03-30T00:18:00.718 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 83 M 2021-03-30T00:18:00.718 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2021-03-30T00:18:00.895 INFO:teuthology.orchestra.run.smithi165.stdout:(1/3): kernel-4.18.0-240.15.1.el8_3.x86_64.rpm 22 MB/s | 4.3 MB 00:00 2021-03-30T00:18:01.340 INFO:teuthology.orchestra.run.smithi165.stdout:(2/3): kernel-core-4.18.0-240.15.1.el8_3.x86_64 47 MB/s | 30 MB 00:00 2021-03-30T00:18:01.697 INFO:teuthology.orchestra.run.smithi165.stdout:(3/3): kernel-modules-4.18.0-240.15.1.el8_3.x86 26 MB/s | 26 MB 00:00 2021-03-30T00:18:01.704 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2021-03-30T00:18:01.705 INFO:teuthology.orchestra.run.smithi165.stdout:Total 60 MB/s | 60 MB 00:01 2021-03-30T00:18:01.785 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2021-03-30T00:18:02.076 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2021-03-30T00:18:02.076 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2021-03-30T00:18:03.098 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2021-03-30T00:18:03.100 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2021-03-30T00:18:05.352 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2021-03-30T00:18:06.017 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-core-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T00:18:08.664 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T00:18:09.008 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T00:18:11.895 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T00:18:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T00:18:34.325 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T00:18:34.580 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T00:18:34.581 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-4.18.0-240.15.1.el8_3.x86_64 1/3 2021-03-30T00:18:34.581 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-core-4.18.0-240.15.1.el8_3.x86_64 2/3 2021-03-30T00:18:34.857 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-modules-4.18.0-240.15.1.el8_3.x86_64 3/3 2021-03-30T00:18:34.857 INFO:teuthology.orchestra.run.smithi165.stdout:Installed products updated. 2021-03-30T00:18:35.183 INFO:teuthology.orchestra.run.smithi165.stdout: 2021-03-30T00:18:35.184 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2021-03-30T00:18:35.185 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:35.185 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-core-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:35.186 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:35.186 INFO:teuthology.orchestra.run.smithi165.stdout: 2021-03-30T00:18:35.186 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2021-03-30T00:18:35.290 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel --last | head -n 1 2021-03-30T00:18:35.397 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-4.18.0-240.15.1.el8_3.x86_64 Tue 30 Mar 2021 12:18:11 AM UTC 2021-03-30T00:18:35.399 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:35.400 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-240.10.1.el8_3.x86_64 Expected: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:35.400 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-03-30T00:18:35.401 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-03-30T00:18:35.401 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-03-30T00:18:35.402 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-03-30T00:18:35.403 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=None, version=distro) 2021-03-30T00:18:35.404 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel --last | head -n 1 2021-03-30T00:18:35.510 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-240.15.1.el8_3.x86_64 Tue 30 Mar 2021 12:17:26 AM UTC 2021-03-30T00:18:35.512 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:35.513 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2021-03-30T00:18:35.556 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2021-03-30T00:18:35.560 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2021-03-30T00:18:35.561 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.02 2021-03-30T00:18:35.561 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 78.el8 2021-03-30T00:18:35.562 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2021-03-30T00:18:35.562 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Sun 28 Feb 2021 12:07:24 PM UTC 2021-03-30T00:18:35.563 INFO:teuthology.orchestra.run.smithi008.stdout:Group : System Environment/Base 2021-03-30T00:18:35.563 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 9192691 2021-03-30T00:18:35.563 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2021-03-30T00:18:35.564 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2021-03-30T00:18:35.564 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2021-03-30T00:18:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2021-03-30T00:18:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : kbuilder.bsys.centos.org 2021-03-30T00:18:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:Relocations : (not relocatable) 2021-03-30T00:18:35.566 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : CentOS BuildSystem 2021-03-30T00:18:35.566 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : CentOS 2021-03-30T00:18:35.567 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2021-03-30T00:18:35.567 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2021-03-30T00:18:35.568 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2021-03-30T00:18:35.568 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-03-30T00:18:35.569 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-03-30T00:18:35.570 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2021-03-30T00:18:35.570 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2021-03-30T00:18:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2021-03-30T00:18:35.571 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-03-30T00:18:35.571 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2021-03-30T00:18:35.573 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-03-30T00:18:35.574 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:35.575 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-03-30T00:18:36.408 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2021-03-30T00:18:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:done 2021-03-30T00:18:38.294 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2021-03-30T00:18:38.329 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.0ntaeUncKk 2021-03-30T00:18:38.330 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0ntaeUncKk 2021-03-30T00:18:38.408 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.0ntaeUncKk 2021-03-30T00:18:38.562 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.0ntaeUncKk is 4KB 2021-03-30T00:18:38.614 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.0ntaeUncKk 2021-03-30T00:18:38.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2021-03-30T00:18:38.713 INFO:teuthology.orchestra.run.smithi008.stdout:6f619c02a7094836b05d959b097bb5e7-0-rescue.conf 2021-03-30T00:18:38.714 INFO:teuthology.orchestra.run.smithi008.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-147.el8.x86_64.conf 2021-03-30T00:18:38.714 INFO:teuthology.orchestra.run.smithi008.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-240.10.1.el8_3.x86_64.conf 2021-03-30T00:18:38.715 INFO:teuthology.orchestra.run.smithi008.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-240.15.1.el8_3.x86_64.conf 2021-03-30T00:18:38.716 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 6f619c02a7094836b05d959b097bb5e7-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:38.882 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2021-03-30T00:18:38.886 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-03-30T00:18:38.887 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi165.front.sepia.ceph.com, path=None, version=distro) 2021-03-30T00:18:38.888 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel --last | head -n 1 2021-03-30T00:18:38.989 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-4.18.0-240.15.1.el8_3.x86_64 Tue 30 Mar 2021 12:18:11 AM UTC 2021-03-30T00:18:38.991 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:38.992 DEBUG:teuthology.orchestra.run.smithi165:> sudo rpm -qi grub2-tools 2021-03-30T00:18:39.029 INFO:teuthology.orchestra.run.smithi165.stdout:Name : grub2-tools 2021-03-30T00:18:39.030 INFO:teuthology.orchestra.run.smithi165.stdout:Epoch : 1 2021-03-30T00:18:39.030 INFO:teuthology.orchestra.run.smithi165.stdout:Version : 2.02 2021-03-30T00:18:39.030 INFO:teuthology.orchestra.run.smithi165.stdout:Release : 78.el8 2021-03-30T00:18:39.030 INFO:teuthology.orchestra.run.smithi165.stdout:Architecture: x86_64 2021-03-30T00:18:39.031 INFO:teuthology.orchestra.run.smithi165.stdout:Install Date: Sun 28 Feb 2021 12:07:24 PM UTC 2021-03-30T00:18:39.031 INFO:teuthology.orchestra.run.smithi165.stdout:Group : System Environment/Base 2021-03-30T00:18:39.031 INFO:teuthology.orchestra.run.smithi165.stdout:Size : 9192691 2021-03-30T00:18:39.031 INFO:teuthology.orchestra.run.smithi165.stdout:License : GPLv3+ 2021-03-30T00:18:39.032 INFO:teuthology.orchestra.run.smithi165.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2021-03-30T00:18:39.032 INFO:teuthology.orchestra.run.smithi165.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2021-03-30T00:18:39.032 INFO:teuthology.orchestra.run.smithi165.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2021-03-30T00:18:39.032 INFO:teuthology.orchestra.run.smithi165.stdout:Build Host : kbuilder.bsys.centos.org 2021-03-30T00:18:39.032 INFO:teuthology.orchestra.run.smithi165.stdout:Relocations : (not relocatable) 2021-03-30T00:18:39.033 INFO:teuthology.orchestra.run.smithi165.stdout:Packager : CentOS BuildSystem 2021-03-30T00:18:39.033 INFO:teuthology.orchestra.run.smithi165.stdout:Vendor : CentOS 2021-03-30T00:18:39.033 INFO:teuthology.orchestra.run.smithi165.stdout:URL : http://www.gnu.org/software/grub/ 2021-03-30T00:18:39.033 INFO:teuthology.orchestra.run.smithi165.stdout:Summary : Support tools for GRUB. 2021-03-30T00:18:39.034 INFO:teuthology.orchestra.run.smithi165.stdout:Description : 2021-03-30T00:18:39.034 INFO:teuthology.orchestra.run.smithi165.stdout: 2021-03-30T00:18:39.034 INFO:teuthology.orchestra.run.smithi165.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-03-30T00:18:39.034 INFO:teuthology.orchestra.run.smithi165.stdout:customizable bootloader with modular architecture. It supports a rich 2021-03-30T00:18:39.034 INFO:teuthology.orchestra.run.smithi165.stdout:variety of kernel formats, file systems, computer architectures and 2021-03-30T00:18:39.035 INFO:teuthology.orchestra.run.smithi165.stdout:hardware devices. 2021-03-30T00:18:39.035 INFO:teuthology.orchestra.run.smithi165.stdout: 2021-03-30T00:18:39.035 INFO:teuthology.orchestra.run.smithi165.stdout:This subpackage provides tools for support of all platforms. 2021-03-30T00:18:39.036 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-03-30T00:18:39.037 INFO:teuthology.task.kernel:Updating grub on smithi165 to boot 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:39.037 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-03-30T00:18:40.314 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2021-03-30T00:18:42.573 INFO:teuthology.orchestra.run.smithi165.stderr:done 2021-03-30T00:18:42.576 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2021-03-30T00:18:42.607 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.W6Laur3QE5 2021-03-30T00:18:42.607 DEBUG:teuthology.orchestra.run.smithi165:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.W6Laur3QE5 2021-03-30T00:18:42.688 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.W6Laur3QE5 2021-03-30T00:18:42.857 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.W6Laur3QE5 is 4KB 2021-03-30T00:18:42.978 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.W6Laur3QE5 2021-03-30T00:18:43.001 DEBUG:teuthology.orchestra.run.smithi165:> sudo /bin/ls /boot/loader/entries || true 2021-03-30T00:18:43.071 INFO:teuthology.orchestra.run.smithi165.stdout:6f619c02a7094836b05d959b097bb5e7-0-rescue.conf 2021-03-30T00:18:43.072 INFO:teuthology.orchestra.run.smithi165.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-147.el8.x86_64.conf 2021-03-30T00:18:43.072 INFO:teuthology.orchestra.run.smithi165.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-240.10.1.el8_3.x86_64.conf 2021-03-30T00:18:43.073 INFO:teuthology.orchestra.run.smithi165.stdout:6f619c02a7094836b05d959b097bb5e7-4.18.0-240.15.1.el8_3.x86_64.conf 2021-03-30T00:18:43.075 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-set-default 6f619c02a7094836b05d959b097bb5e7-4.18.0-240.15.1.el8_3.x86_64 2021-03-30T00:18:43.209 DEBUG:teuthology.orchestra.run.smithi165:> sudo shutdown -r now 2021-03-30T00:19:13.249 INFO:teuthology.misc:Re-opening connections... 2021-03-30T00:19:13.252 INFO:teuthology.misc:trying to connect to ubuntu@smithi008.front.sepia.ceph.com 2021-03-30T00:19:13.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-30T00:19:13.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T00:19:31.591 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2021-03-30T00:19:31.598 INFO:teuthology.misc:trying to connect to ubuntu@smithi165.front.sepia.ceph.com 2021-03-30T00:19:31.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-30T00:19:31.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T00:19:50.027 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2021-03-30T00:19:50.029 DEBUG:teuthology.misc:waited 36.77740502357483 2021-03-30T00:19:51.031 INFO:teuthology.misc:trying to connect to ubuntu@smithi008.front.sepia.ceph.com 2021-03-30T00:19:51.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-30T00:19:51.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T00:19:54.095 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2021-03-30T00:19:54.096 INFO:teuthology.misc:trying to connect to ubuntu@smithi165.front.sepia.ceph.com 2021-03-30T00:19:54.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-30T00:19:54.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T00:20:38.891 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-03-30T00:20:38.893 DEBUG:teuthology.task.console_log:Killing console logger for smithi008 2021-03-30T00:20:38.893 DEBUG:teuthology.task.console_log:Killing console logger for smithi165 2021-03-30T00:20:38.894 DEBUG:teuthology.exit:Finished running handlers