2021-08-21T15:03:23.444 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-21T15:03:23.446 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} --archive /home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350515 --owner scheduled_yuriw@teuthology --verbose --name yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi -- /home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350515/orig.config.yaml 2021-08-21T15:03:23.504 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-08-21T15:03:23.579 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350515 branch: wip-yuri-master-8.20.21 description: rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6350515' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: centos os_version: '8.3' overrides: admin_socket: branch: wip-yuri-master-8.20.21 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async osd_async_recovery_min_cost: 1 osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_object_clean_region_max_num_intervals: 1000 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd max scrubs: 3 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 min_in: 4 workunit: branch: wip-yuri-master-8.20.21 sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 owner: scheduled_yuriw@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri-master-8.20.21 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_cae1ffd55a16af4627c36508fde05bf24312fad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 targets: smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2wW9jhEkXCVucpeWys656yRbSh+/boDdg1g2228J+c/bC76ancpOS6iFsrHL3/2nOz5jvTMIgJ6v7lpdXhJm3lfGUbKRvNjxJpaOzGzDRomqq+sJL5QeAlyqdYhk1Mqx3OjFJHV+g5N8gHDgjm5+LRxUySNK2k49302U1Jnw2r2p6dviDfoBGNBAaZrzbdIpubIahSvgMy9ziILTuDh0ilNmoVAlQuiNBlErFEe1nXOi+SonUbpAOME7umqxvjXSFfpk5QwqbURA6m2buDdIDCyBmxGLFe49uJriz736769HH39YzcAJ0pd4m2003FkF8ex3Vq0/KKE5l4S8SXtmMYwvMK6ENXRPztNz2NxV9p9tPtBV7Miy2JalZNTXsRe+ik7QVhyUIVQqm+vO/kdy9p7j6z7jXtjZQzphZKM/ggB3kMr8WjFoiRSsaPgyAuVAteqU4djkGXTItPf7XQecMiGSJvZRagWRIXMjlBPXAKlgnRaXzCHEQKbIMipubqr8= smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCo/MHrE8y10V8NzAEiUF0EyWwh3kdmMgQfuG0u19pPKs+QZblAaBBa4blZ2ZBEWKnfOlg0pio29rmqLS8gwuc4N5J67J7fIB3/qTF7BrmDXpn5fdmsTWDr+kkjVEG+5espAkYZSqzuPrDMkATvFZACQ3gOYX5RiZ4et613DxwSEXVzS9kr5n0+5GPUX8TbXSFupz1X0ybh5YCZ4i2MBBvnqWlmo9lyUBfYxEYKmryRlcYf8BrbEUT3XILHLfTCTTQTYV41HRp6PPaVB+x9SsoboHkZ7lh+EfoNjycsVcClzG2jgFaEOkDmbVa5jJqsYhwvxNjRarL7IXMNOe1HRgMguJ41UbcGpo2bpuA04XRJCq17wSBqRPQL+dgtXKW1VsbtEnRwTbyq70EX0Uq+TxU8a2vFyQUqJQe1GKGC/kToboORBbUse3kFCkWdo8Y8OEclyyfWvHK0O7+HlYsRpHRvk23UY6CnRosAbIiSLh089F5GL+ooRNxvMlrCSB9755U= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: bluestore_new_sharding: random chance_bluestore_reshard: 1 chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 timeout: 1200 - exec: client.0: - sudo ceph osd pool create low_tier 4 - rados: clients: - client.0 low_tier_pool: low_tier objects: 500 op_weights: read: 50 set_redirect: 100 tier_promote: 30 ops: 4000 set_redirect: true teuthology_branch: master teuthology_sha1: 321319b12ea4ff9b63c7655015a3156de2c3b279 timestamp: 2021-08-21_14:21:15 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.30581 2021-08-21T15:03:23.580 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_cae1ffd55a16af4627c36508fde05bf24312fad6/qa; will attempt to use it 2021-08-21T15:03:23.581 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_cae1ffd55a16af4627c36508fde05bf24312fad6/qa/tasks 2021-08-21T15:03:23.581 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-08-21T15:03:23.583 INFO:teuthology.task.internal:Checking packages... 2021-08-21T15:03:23.607 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'cae1ffd55a16af4627c36508fde05bf24312fad6' 2021-08-21T15:03:23.608 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-08-21T15:03:23.608 INFO:teuthology.packaging:ref: None 2021-08-21T15:03:23.609 INFO:teuthology.packaging:tag: None 2021-08-21T15:03:23.609 INFO:teuthology.packaging:branch: wip-yuri-master-8.20.21 2021-08-21T15:03:23.609 INFO:teuthology.packaging:sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 2021-08-21T15:03:23.610 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-master-8.20.21 2021-08-21T15:03:23.764 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-7135.gcae1ffd5 2021-08-21T15:03:23.765 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-08-21T15:03:23.775 INFO:teuthology.task.internal:no buildpackages task found 2021-08-21T15:03:23.776 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-08-21T15:03:23.845 INFO:teuthology.task.internal:Saving configuration 2021-08-21T15:03:23.864 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-08-21T15:03:23.882 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-21T15:03:23.904 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-08-21 14:58:32.454988', 'description': '/home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350515', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcW1t5DLK3vkEA2IpCD+s9IcyY9oIt6enNpdUohWf+AqHkoUNru0HQS2ieza7Npo2bMs8RU94GZsmSIjBtXDCI=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi016.front.sepia.ceph.com'} 2021-08-21T15:03:23.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-08-21 14:58:32.454967', 'description': '/home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350515', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOGy70+Lx90qilh0OwPvWnV8r2OUzqUn7+MFWkT60xPE4vivdsbdUXWpxaSP+k+Shmw3lY+w1BFEkqEMWtwzHEw=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi192.front.sepia.ceph.com'} 2021-08-21T15:03:23.922 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-08-21T15:03:23.940 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-08-21T15:03:23.940 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-08-21T15:03:23.941 INFO:teuthology.run_tasks:Running task console_log... 2021-08-21T15:03:24.066 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2786f7cb70>, signals=[15]) 2021-08-21T15:03:24.067 INFO:teuthology.run_tasks:Running task internal.connect... 2021-08-21T15:03:24.082 INFO:teuthology.task.internal:Opening connections... 2021-08-21T15:03:24.082 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2021-08-21T15:03:24.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-21T15:03:24.159 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2021-08-21T15:03:24.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-21T15:03:24.232 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-08-21T15:03:24.241 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2021-08-21T15:03:24.266 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2021-08-21T15:03:24.266 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2021-08-21T15:03:24.325 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Linux" 2021-08-21T15:03:24.326 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8" 2021-08-21T15:03:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2021-08-21T15:03:24.327 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2021-08-21T15:03:24.328 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8" 2021-08-21T15:03:24.328 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2021-08-21T15:03:24.329 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Linux 8" 2021-08-21T15:03:24.329 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2021-08-21T15:03:24.330 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-08-21T15:03:24.331 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2021-08-21T15:03:24.332 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-08-21T15:03:24.332 INFO:teuthology.orchestra.run.smithi016.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-08-21T15:03:24.333 INFO:teuthology.orchestra.run.smithi016.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-08-21T15:03:24.334 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-08-21T15:03:24.362 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2021-08-21T15:03:24.384 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2021-08-21T15:03:24.385 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2021-08-21T15:03:24.443 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Linux" 2021-08-21T15:03:24.444 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2021-08-21T15:03:24.445 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2021-08-21T15:03:24.445 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2021-08-21T15:03:24.445 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2021-08-21T15:03:24.446 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2021-08-21T15:03:24.446 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Linux 8" 2021-08-21T15:03:24.447 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2021-08-21T15:03:24.447 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-08-21T15:03:24.448 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2021-08-21T15:03:24.448 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-08-21T15:03:24.448 INFO:teuthology.orchestra.run.smithi192.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-08-21T15:03:24.449 INFO:teuthology.orchestra.run.smithi192.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-08-21T15:03:24.450 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2021-08-21T15:03:24.472 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-08-21T15:03:24.488 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-08-21T15:03:24.547 INFO:teuthology.task.internal:Checking for old test directory... 2021-08-21T15:03:24.547 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2021-08-21T15:03:24.551 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2021-08-21T15:03:24.568 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-08-21T15:03:24.588 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-08-21T15:03:24.589 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2021-08-21T15:03:24.614 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2021-08-21T15:03:24.648 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-08-21T15:03:24.711 INFO:teuthology.run_tasks:Running task kernel... 2021-08-21T15:03:24.738 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-08-21T15:03:24.740 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-08-21T15:03:24.740 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2021-08-21T15:03:24.768 INFO:teuthology.orchestra.run.smithi016.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-08-21T15:03:24.769 INFO:teuthology.task.kernel:Running kernel on smithi016: 4.18.0-305.10.2.el8_4.x86_64 2021-08-21T15:03:24.769 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum install -y kernel 2021-08-21T15:03:27.053 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS-8 - AppStream 43 MB/s | 8.8 MB 00:00 2021-08-21T15:03:28.683 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS-8 - Base 40 MB/s | 5.6 MB 00:00 2021-08-21T15:03:29.569 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS-8 - Extras 132 kB/s | 10 kB 00:00 2021-08-21T15:03:30.407 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Linux 8 - AppStream 11 MB/s | 8.8 MB 00:00 2021-08-21T15:03:33.489 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Linux 8 - BaseOS 3.5 MB/s | 5.6 MB 00:01 2021-08-21T15:03:34.511 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Linux 8 - Extras 56 kB/s | 10 kB 00:00 2021-08-21T15:03:34.666 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS-8 - PowerTools 25 MB/s | 2.3 MB 00:00 2021-08-21T15:03:36.862 INFO:teuthology.orchestra.run.smithi016.stdout:Copr repo for python3-asyncssh owned by ceph 2.0 kB/s | 3.5 kB 00:01 2021-08-21T15:03:37.641 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 14 MB/s | 10 MB 00:00 2021-08-21T15:03:39.928 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2021-08-21T15:03:42.080 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-08-21T15:03:42.080 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-08-21T15:03:42.405 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2021-08-21T15:03:42.406 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2021-08-21T15:03:42.406 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2021-08-21T15:03:42.407 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2021-08-21T15:03:42.407 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2021-08-21T15:03:42.407 INFO:teuthology.orchestra.run.smithi016.stdout: kernel x86_64 4.18.0-305.12.1.el8_4 CentOS-Base 5.9 M 2021-08-21T15:03:42.407 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2021-08-21T15:03:42.408 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core x86_64 4.18.0-305.12.1.el8_4 CentOS-Base 36 M 2021-08-21T15:03:42.408 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules x86_64 4.18.0-305.12.1.el8_4 CentOS-Base 28 M 2021-08-21T15:03:42.408 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-08-21T15:03:42.408 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2021-08-21T15:03:42.409 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2021-08-21T15:03:42.409 INFO:teuthology.orchestra.run.smithi016.stdout:Install 3 Packages 2021-08-21T15:03:42.409 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-08-21T15:03:42.409 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 70 M 2021-08-21T15:03:42.409 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 88 M 2021-08-21T15:03:42.410 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2021-08-21T15:03:42.518 INFO:teuthology.orchestra.run.smithi016.stdout:(1/3): kernel-4.18.0-305.12.1.el8_4.x86_64.rpm 50 MB/s | 5.9 MB 00:00 2021-08-21T15:03:43.319 INFO:teuthology.orchestra.run.smithi016.stdout:(2/3): kernel-core-4.18.0-305.12.1.el8_4.x86_64 39 MB/s | 36 MB 00:00 2021-08-21T15:03:43.553 INFO:teuthology.orchestra.run.smithi016.stdout:(3/3): kernel-modules-4.18.0-305.12.1.el8_4.x86 24 MB/s | 28 MB 00:01 2021-08-21T15:03:43.558 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:03:43.558 INFO:teuthology.orchestra.run.smithi016.stdout:Total 60 MB/s | 70 MB 00:01 2021-08-21T15:03:43.677 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2021-08-21T15:03:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2021-08-21T15:03:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2021-08-21T15:03:45.247 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2021-08-21T15:03:45.263 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2021-08-21T15:03:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2021-08-21T15:03:48.317 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-core-4.18.0-305.12.1.el8_4.x86_64 1/3 2021-08-21T15:03:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-4.18.0-305.12.1.el8_4.x86_64 1/3 2021-08-21T15:03:52.067 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-4.18.0-305.12.1.el8_4.x86_64 2/3 2021-08-21T15:03:55.265 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-4.18.0-305.12.1.el8_4.x86_64 2/3 2021-08-21T15:03:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T15:04:17.410 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T15:04:17.720 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T15:04:17.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-4.18.0-305.12.1.el8_4.x86_64 1/3 2021-08-21T15:04:17.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-core-4.18.0-305.12.1.el8_4.x86_64 2/3 2021-08-21T15:04:18.143 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T15:04:18.143 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-08-21T15:04:18.143 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2021-08-21T15:04:18.144 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:04:18.144 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:04:18.145 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:04:18.145 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-08-21T15:04:18.145 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2021-08-21T15:04:18.215 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel --last | head -n 1 2021-08-21T15:04:18.368 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-4.18.0-305.12.1.el8_4.x86_64 Sat 21 Aug 2021 03:03:55 PM UTC 2021-08-21T15:04:18.369 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:04:18.369 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:04:18.370 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2021-08-21T15:04:18.392 INFO:teuthology.orchestra.run.smithi192.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-08-21T15:04:18.392 INFO:teuthology.task.kernel:Running kernel on smithi192: 4.18.0-305.10.2.el8_4.x86_64 2021-08-21T15:04:18.393 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2021-08-21T15:04:20.738 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS-8 - AppStream 44 MB/s | 8.8 MB 00:00 2021-08-21T15:04:22.236 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS-8 - Base 44 MB/s | 5.6 MB 00:00 2021-08-21T15:04:23.055 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS-8 - Extras 163 kB/s | 10 kB 00:00 2021-08-21T15:04:24.224 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Linux 8 - AppStream 7.9 MB/s | 8.8 MB 00:01 2021-08-21T15:04:27.300 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Linux 8 - BaseOS 3.3 MB/s | 5.6 MB 00:01 2021-08-21T15:04:28.399 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Linux 8 - Extras 31 kB/s | 10 kB 00:00 2021-08-21T15:04:28.545 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS-8 - PowerTools 25 MB/s | 2.3 MB 00:00 2021-08-21T15:04:30.725 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 2.0 kB/s | 3.5 kB 00:01 2021-08-21T15:04:31.495 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 14 MB/s | 10 MB 00:00 2021-08-21T15:04:33.726 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2021-08-21T15:04:35.683 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-08-21T15:04:35.684 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-08-21T15:04:35.992 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2021-08-21T15:04:35.993 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2021-08-21T15:04:35.993 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2021-08-21T15:04:35.994 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2021-08-21T15:04:35.994 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2021-08-21T15:04:35.994 INFO:teuthology.orchestra.run.smithi192.stdout: kernel x86_64 4.18.0-305.12.1.el8_4 CentOS-Base 5.9 M 2021-08-21T15:04:35.994 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2021-08-21T15:04:35.995 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core x86_64 4.18.0-305.12.1.el8_4 CentOS-Base 36 M 2021-08-21T15:04:35.995 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules x86_64 4.18.0-305.12.1.el8_4 CentOS-Base 28 M 2021-08-21T15:04:35.995 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-08-21T15:04:35.995 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2021-08-21T15:04:35.995 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2021-08-21T15:04:35.996 INFO:teuthology.orchestra.run.smithi192.stdout:Install 3 Packages 2021-08-21T15:04:35.996 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-08-21T15:04:35.997 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 70 M 2021-08-21T15:04:35.997 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 88 M 2021-08-21T15:04:35.997 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2021-08-21T15:04:36.337 INFO:teuthology.orchestra.run.smithi192.stdout:(1/3): kernel-4.18.0-305.12.1.el8_4.x86_64.rpm 17 MB/s | 5.9 MB 00:00 2021-08-21T15:04:36.800 INFO:teuthology.orchestra.run.smithi192.stdout:(2/3): kernel-modules-4.18.0-305.12.1.el8_4.x86 35 MB/s | 28 MB 00:00 2021-08-21T15:04:37.054 INFO:teuthology.orchestra.run.smithi192.stdout:(3/3): kernel-core-4.18.0-305.12.1.el8_4.x86_64 34 MB/s | 36 MB 00:01 2021-08-21T15:04:37.057 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:04:37.058 INFO:teuthology.orchestra.run.smithi192.stdout:Total 66 MB/s | 70 MB 00:01 2021-08-21T15:04:37.171 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2021-08-21T15:04:37.505 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2021-08-21T15:04:37.505 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2021-08-21T15:04:38.698 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2021-08-21T15:04:38.711 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2021-08-21T15:04:41.154 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2021-08-21T15:04:41.635 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-core-4.18.0-305.12.1.el8_4.x86_64 1/3 2021-08-21T15:04:44.826 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-4.18.0-305.12.1.el8_4.x86_64 1/3 2021-08-21T15:04:45.193 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-4.18.0-305.12.1.el8_4.x86_64 2/3 2021-08-21T15:04:48.165 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-4.18.0-305.12.1.el8_4.x86_64 2/3 2021-08-21T15:04:48.362 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T15:05:08.821 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T15:05:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T15:05:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-4.18.0-305.12.1.el8_4.x86_64 1/3 2021-08-21T15:05:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-core-4.18.0-305.12.1.el8_4.x86_64 2/3 2021-08-21T15:05:09.478 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T15:05:09.479 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-08-21T15:05:09.479 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2021-08-21T15:05:09.479 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:09.479 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:09.480 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:09.480 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-08-21T15:05:09.480 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2021-08-21T15:05:09.540 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel --last | head -n 1 2021-08-21T15:05:09.689 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-4.18.0-305.12.1.el8_4.x86_64 Sat 21 Aug 2021 03:04:48 PM UTC 2021-08-21T15:05:09.690 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:09.691 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:09.691 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-08-21T15:05:09.691 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-08-21T15:05:09.692 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-08-21T15:05:09.692 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-08-21T15:05:09.692 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2021-08-21T15:05:09.693 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel --last | head -n 1 2021-08-21T15:05:09.840 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-4.18.0-305.12.1.el8_4.x86_64 Sat 21 Aug 2021 03:03:55 PM UTC 2021-08-21T15:05:09.842 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:09.844 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -qi grub2-tools 2021-08-21T15:05:09.879 INFO:teuthology.orchestra.run.smithi016.stdout:Name : grub2-tools 2021-08-21T15:05:09.879 INFO:teuthology.orchestra.run.smithi016.stdout:Epoch : 1 2021-08-21T15:05:09.880 INFO:teuthology.orchestra.run.smithi016.stdout:Version : 2.02 2021-08-21T15:05:09.880 INFO:teuthology.orchestra.run.smithi016.stdout:Release : 90.el8 2021-08-21T15:05:09.880 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: x86_64 2021-08-21T15:05:09.882 INFO:teuthology.orchestra.run.smithi016.stdout:Install Date: Wed 11 Aug 2021 06:38:04 PM UTC 2021-08-21T15:05:09.882 INFO:teuthology.orchestra.run.smithi016.stdout:Group : System Environment/Base 2021-08-21T15:05:09.883 INFO:teuthology.orchestra.run.smithi016.stdout:Size : 9197207 2021-08-21T15:05:09.883 INFO:teuthology.orchestra.run.smithi016.stdout:License : GPLv3+ 2021-08-21T15:05:09.883 INFO:teuthology.orchestra.run.smithi016.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-08-21T15:05:09.883 INFO:teuthology.orchestra.run.smithi016.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-08-21T15:05:09.883 INFO:teuthology.orchestra.run.smithi016.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-08-21T15:05:09.884 INFO:teuthology.orchestra.run.smithi016.stdout:Build Host : kbuilder.bsys.centos.org 2021-08-21T15:05:09.884 INFO:teuthology.orchestra.run.smithi016.stdout:Relocations : (not relocatable) 2021-08-21T15:05:09.884 INFO:teuthology.orchestra.run.smithi016.stdout:Packager : CentOS BuildSystem 2021-08-21T15:05:09.884 INFO:teuthology.orchestra.run.smithi016.stdout:Vendor : CentOS 2021-08-21T15:05:09.885 INFO:teuthology.orchestra.run.smithi016.stdout:URL : http://www.gnu.org/software/grub/ 2021-08-21T15:05:09.885 INFO:teuthology.orchestra.run.smithi016.stdout:Summary : Support tools for GRUB. 2021-08-21T15:05:09.885 INFO:teuthology.orchestra.run.smithi016.stdout:Description : 2021-08-21T15:05:09.885 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-08-21T15:05:09.885 INFO:teuthology.orchestra.run.smithi016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-08-21T15:05:09.886 INFO:teuthology.orchestra.run.smithi016.stdout:customizable bootloader with modular architecture. It supports a rich 2021-08-21T15:05:09.886 INFO:teuthology.orchestra.run.smithi016.stdout:variety of kernel formats, file systems, computer architectures and 2021-08-21T15:05:09.887 INFO:teuthology.orchestra.run.smithi016.stdout:hardware devices. 2021-08-21T15:05:09.887 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-08-21T15:05:09.887 INFO:teuthology.orchestra.run.smithi016.stdout:This subpackage provides tools for support of all platforms. 2021-08-21T15:05:09.889 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-08-21T15:05:09.889 INFO:teuthology.task.kernel:Updating grub on smithi016 to boot 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:09.889 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-08-21T15:05:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2021-08-21T15:05:12.612 INFO:teuthology.orchestra.run.smithi016.stderr:done 2021-08-21T15:05:12.614 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-08-21T15:05:12.667 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.Bszze7dyk7 2021-08-21T15:05:12.667 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Bszze7dyk7 2021-08-21T15:05:12.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.Bszze7dyk7 2021-08-21T15:05:12.845 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.Bszze7dyk7 is 6KB 2021-08-21T15:05:12.920 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.Bszze7dyk7 2021-08-21T15:05:12.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo /bin/ls /boot/loader/entries || true 2021-08-21T15:05:13.004 INFO:teuthology.orchestra.run.smithi016.stdout:ecc66dffcd264e5181894e69c53ff13c-0-rescue.conf 2021-08-21T15:05:13.005 INFO:teuthology.orchestra.run.smithi016.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-240.el8.x86_64.conf 2021-08-21T15:05:13.005 INFO:teuthology.orchestra.run.smithi016.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.10.2.el8_4.x86_64.conf 2021-08-21T15:05:13.005 INFO:teuthology.orchestra.run.smithi016.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.12.1.el8_4.x86_64.conf 2021-08-21T15:05:13.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-set-default ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:13.145 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2021-08-21T15:05:13.149 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-08-21T15:05:13.149 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2021-08-21T15:05:13.149 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel --last | head -n 1 2021-08-21T15:05:13.291 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-4.18.0-305.12.1.el8_4.x86_64 Sat 21 Aug 2021 03:04:48 PM UTC 2021-08-21T15:05:13.292 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:13.293 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2021-08-21T15:05:13.327 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2021-08-21T15:05:13.328 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2021-08-21T15:05:13.328 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.02 2021-08-21T15:05:13.328 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 90.el8 2021-08-21T15:05:13.329 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2021-08-21T15:05:13.331 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Wed 11 Aug 2021 06:38:04 PM UTC 2021-08-21T15:05:13.331 INFO:teuthology.orchestra.run.smithi192.stdout:Group : System Environment/Base 2021-08-21T15:05:13.331 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 9197207 2021-08-21T15:05:13.332 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2021-08-21T15:05:13.333 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-08-21T15:05:13.333 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-08-21T15:05:13.333 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-08-21T15:05:13.334 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : kbuilder.bsys.centos.org 2021-08-21T15:05:13.334 INFO:teuthology.orchestra.run.smithi192.stdout:Relocations : (not relocatable) 2021-08-21T15:05:13.334 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : CentOS BuildSystem 2021-08-21T15:05:13.334 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : CentOS 2021-08-21T15:05:13.335 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2021-08-21T15:05:13.336 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2021-08-21T15:05:13.336 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2021-08-21T15:05:13.336 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-08-21T15:05:13.338 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-08-21T15:05:13.338 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2021-08-21T15:05:13.338 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2021-08-21T15:05:13.338 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2021-08-21T15:05:13.339 INFO:teuthology.orchestra.run.smithi192.stdout: 2021-08-21T15:05:13.339 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2021-08-21T15:05:13.340 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-08-21T15:05:13.342 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:13.343 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-08-21T15:05:14.668 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2021-08-21T15:05:17.018 INFO:teuthology.orchestra.run.smithi192.stderr:done 2021-08-21T15:05:17.019 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2021-08-21T15:05:17.034 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.x8e4hlgxWY 2021-08-21T15:05:17.035 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.x8e4hlgxWY 2021-08-21T15:05:17.104 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.x8e4hlgxWY 2021-08-21T15:05:17.277 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.x8e4hlgxWY is 6KB 2021-08-21T15:05:17.328 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.x8e4hlgxWY 2021-08-21T15:05:17.347 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2021-08-21T15:05:17.410 INFO:teuthology.orchestra.run.smithi192.stdout:ecc66dffcd264e5181894e69c53ff13c-0-rescue.conf 2021-08-21T15:05:17.411 INFO:teuthology.orchestra.run.smithi192.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-240.el8.x86_64.conf 2021-08-21T15:05:17.412 INFO:teuthology.orchestra.run.smithi192.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.10.2.el8_4.x86_64.conf 2021-08-21T15:05:17.412 INFO:teuthology.orchestra.run.smithi192.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.12.1.el8_4.x86_64.conf 2021-08-21T15:05:17.413 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T15:05:17.574 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2021-08-21T15:05:47.610 INFO:teuthology.misc:Re-opening connections... 2021-08-21T15:05:47.611 INFO:teuthology.misc:trying to connect to ubuntu@smithi016.front.sepia.ceph.com 2021-08-21T15:05:47.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-21T15:05:47.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-21T15:05:54.907 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-08-21T15:05:54.908 DEBUG:teuthology.task.console_log:Killing console logger for smithi016 2021-08-21T15:05:54.909 DEBUG:teuthology.task.console_log:Killing console logger for smithi192 2021-08-21T15:05:54.909 DEBUG:teuthology.exit:Finished running handlers