2021-10-13T04:09:29.409 INFO:root:teuthology version: 1.1.0-6f40c4ca 2021-10-13T04:09:29.411 DEBUG:teuthology.run:Teuthology command: teuthology --block --lock --owner scheduled_yuriw@teuthology --name yuriw-2021-10-12_12:50:50-rados-wip-yuri7-testing-2021-10-08-0924-distro-basic-smithi --archive /home/teuthworker/archive/yuriw-2021-10-12_12:50:50-rados-wip-yuri7-testing-2021-10-08-0924-distro-basic-smithi/6433623 --verbose --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /tmp/teuthology-worker.l7l7awhl.tmp 2021-10-13T04:09:29.450 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-10-13T04:09:29.513 INFO:teuthology.run:Config: arch: x86_64 archive_path: /home/teuthworker/archive/yuriw-2021-10-12_12:50:50-rados-wip-yuri7-testing-2021-10-08-0924-distro-basic-smithi/6433623 branch: wip-yuri7-testing-2021-10-08-0924 description: rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} email: ceph-qa@ceph.io first_in_suite: false job_id: '6433623' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2021-10-12_12:50:50-rados-wip-yuri7-testing-2021-10-08-0924-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 - volumes: size: 50 os_type: centos os_version: '8.3' overrides: admin_socket: branch: wip-yuri7-testing-2021-10-08-0924 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 osd_async_recovery_min_cost: 1 osd_object_clean_region_max_num_intervals: 1000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore queue throttle high multiple: 2 filestore queue throttle max multiple: 10 journal throttle high multiple: 2 journal throttle max multiple: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd max backfills: 9 osd max markdown count: 1000 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 0fd834746e193d64ab7658be587f243d8eb574bb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 0fd834746e193d64ab7658be587f243d8eb574bb selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri7-testing-2021-10-08-0924 sha1: 0fd834746e193d64ab7658be587f243d8eb574bb owner: scheduled_yuriw@teuthology priority: 79 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 0fd834746e193d64ab7658be587f243d8eb574bb sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri7-testing-2021-10-08-0924 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0fd834746e193d64ab7658be587f243d8eb574bb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0fd834746e193d64ab7658be587f243d8eb574bb tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: chance_pgnum_grow: 3 chance_pgpnum_fix: 1 timeout: 1200 - rados: clients: - client.0 ec_pool: true erasure_code_profile: crush-failure-domain: osd k: 2 m: 1 name: isaprofile plugin: isa technique: reed_sol_van min_size: 2 objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false teuthology_branch: master teuthology_sha1: 6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b timestamp: 2021-10-12_12:50:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.12642 2021-10-13T04:09:29.513 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0fd834746e193d64ab7658be587f243d8eb574bb/qa; will attempt to use it 2021-10-13T04:09:29.514 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0fd834746e193d64ab7658be587f243d8eb574bb/qa/tasks 2021-10-13T04:09:29.514 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-10-13T04:09:29.516 INFO:teuthology.task.internal:Checking packages... 2021-10-13T04:09:29.537 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '0fd834746e193d64ab7658be587f243d8eb574bb' 2021-10-13T04:09:29.538 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-10-13T04:09:29.538 INFO:teuthology.packaging:ref: None 2021-10-13T04:09:29.539 INFO:teuthology.packaging:tag: None 2021-10-13T04:09:29.539 INFO:teuthology.packaging:branch: wip-yuri7-testing-2021-10-08-0924 2021-10-13T04:09:29.539 INFO:teuthology.packaging:sha1: 0fd834746e193d64ab7658be587f243d8eb574bb 2021-10-13T04:09:29.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri7-testing-2021-10-08-0924 2021-10-13T04:09:29.697 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-8116.g0fd83474 2021-10-13T04:09:29.698 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-10-13T04:09:29.707 INFO:teuthology.task.internal:no buildpackages task found 2021-10-13T04:09:29.707 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-10-13T04:09:29.729 INFO:teuthology.lock.ops:Locking machines... 2021-10-13T04:09:29.730 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-10-13T04:09:29.792 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_yuriw@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/yuriw-2021-10-12_12:50:50-rados-wip-yuri7-testing-2021-10-08-0924-distro-basic-smithi/6433623', 'arch': 'x86_64'} 2021-10-13T04:09:29.811 DEBUG:teuthology.lock.ops:locked ubuntu@smithi179.front.sepia.ceph.com, ubuntu@smithi045.front.sepia.ceph.com 2021-10-13T04:09:29.866 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f840432dd08>, signals=[15]) 2021-10-13T04:09:29.868 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi179.front.sepia.ceph.com' reimaging 2021-10-13T04:09:29.869 INFO:teuthology.lock.ops:Updating [ubuntu@smithi179.front.sepia.ceph.com]: reset os type and version on server 2021-10-13T04:09:29.869 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2021-10-13T04:09:29.889 INFO:teuthology.lock.ops:Node 'ubuntu@smithi179.front.sepia.ceph.com' reimaging is complete 2021-10-13T04:09:29.890 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi045.front.sepia.ceph.com' reimaging 2021-10-13T04:09:29.890 INFO:teuthology.lock.ops:Updating [ubuntu@smithi045.front.sepia.ceph.com]: reset os type and version on server 2021-10-13T04:09:29.891 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2021-10-13T04:09:29.911 INFO:teuthology.lock.ops:Node 'ubuntu@smithi045.front.sepia.ceph.com' reimaging is complete 2021-10-13T04:09:30.100 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 8.3 2021-10-13T04:09:30.112 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 8.3 2021-10-13T04:09:30.410 INFO:teuthology.orchestra.console:Power off smithi179 2021-10-13T04:09:30.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-10-13T04:09:30.425 INFO:teuthology.orchestra.console:Power off smithi045 2021-10-13T04:09:30.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-10-13T04:09:30.433 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:30.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:34.458 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:34.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:38.570 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:38.578 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:38.786 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2021-10-13T04:09:38.887 INFO:teuthology.orchestra.console:Power on smithi045 2021-10-13T04:09:38.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-10-13T04:09:38.907 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:42.685 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:42.894 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2021-10-13T04:09:42.929 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:42.996 INFO:teuthology.orchestra.console:Power on smithi179 2021-10-13T04:09:42.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-10-13T04:09:43.015 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:47.038 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:47.045 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-10-13T04:09:47.248 INFO:teuthology.orchestra.console:Power on for smithi179 completed 2021-10-13T04:09:47.254 INFO:teuthology.orchestra.console:Power on for smithi045 completed 2021-10-13T04:09:47.349 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2021-10-13T04:09:47.355 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2021-10-13T04:12:03.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:12:18.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:12:27.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:12:36.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:12:42.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:12:45.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:12:51.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:13:00.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:13:09.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:13:18.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:13:52.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:13:52.315 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-13T04:13:52.317 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-10-13T04:13:52.618 INFO:teuthology.provision.fog.smithi045:Node is ready 2021-10-13T04:13:52.619 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2021-10-13T04:13:52.635 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2021-10-13T04:13:52.636 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2021-10-13T04:13:52.694 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2021-10-13T04:13:52.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2021-10-13T04:13:52.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2021-10-13T04:13:52.866 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2021-10-13T04:13:52.935 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2021-10-13T04:13:53.003 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2021-10-13T04:13:53.071 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2021-10-13T04:13:53.072 DEBUG:teuthology.parallel:result is None 2021-10-13T04:14:24.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:14:25.227 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-13T04:14:25.227 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-10-13T04:14:25.574 INFO:teuthology.provision.fog.smithi179:Node is ready 2021-10-13T04:14:25.575 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2021-10-13T04:14:25.590 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2021-10-13T04:14:25.590 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2021-10-13T04:14:25.644 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2021-10-13T04:14:25.645 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2021-10-13T04:14:25.746 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2021-10-13T04:14:25.770 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2021-10-13T04:14:25.834 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2021-10-13T04:14:25.898 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2021-10-13T04:14:25.962 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2021-10-13T04:14:25.963 DEBUG:teuthology.parallel:result is None 2021-10-13T04:14:26.113 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2021-10-13T04:14:26.114 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-13T04:14:26.132 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2021-10-13T04:14:26.132 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-13T04:14:26.150 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2021-10-13T04:14:26.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2021-10-13T04:14:26.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:14:26.216 DEBUG:teuthology.orchestra.run.smithi179:> true 2021-10-13T04:14:26.353 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2021-10-13T04:14:26.407 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2021-10-13T04:14:26.408 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2021-10-13T04:14:26.461 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Linux" 2021-10-13T04:14:26.461 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2021-10-13T04:14:26.462 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2021-10-13T04:14:26.462 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2021-10-13T04:14:26.462 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2021-10-13T04:14:26.462 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2021-10-13T04:14:26.463 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-13T04:14:26.463 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2021-10-13T04:14:26.463 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-13T04:14:26.463 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2021-10-13T04:14:26.464 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-13T04:14:26.464 INFO:teuthology.orchestra.run.smithi179.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-13T04:14:26.464 INFO:teuthology.orchestra.run.smithi179.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-13T04:14:26.465 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2021-10-13T04:14:26.482 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2021-10-13T04:14:26.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2021-10-13T04:14:26.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:14:26.553 DEBUG:teuthology.orchestra.run.smithi045:> true 2021-10-13T04:14:26.682 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2021-10-13T04:14:26.742 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2021-10-13T04:14:26.747 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2021-10-13T04:14:26.801 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Linux" 2021-10-13T04:14:26.801 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2021-10-13T04:14:26.801 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2021-10-13T04:14:26.802 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2021-10-13T04:14:26.802 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2021-10-13T04:14:26.802 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2021-10-13T04:14:26.803 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-13T04:14:26.803 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2021-10-13T04:14:26.803 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-13T04:14:26.803 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2021-10-13T04:14:26.803 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-13T04:14:26.804 INFO:teuthology.orchestra.run.smithi045.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-13T04:14:26.804 INFO:teuthology.orchestra.run.smithi045.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-13T04:14:26.805 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2021-10-13T04:14:26.830 INFO:teuthology.lock.ops:2 smithi machines locked this try, 2/2 locked so far 2021-10-13T04:14:26.872 INFO:teuthology.lock.ops:Locked targets: smithi045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8MBN3Qt+FZc1bgGWp2Eg2Z553KDXrtCP8E5P609b4avFMfZA6cn+8fKGAH5ZvzUE8ZYRFm1GkzY0Aai2Mx2XgdQ0lmkkYSBKvqS6EjePoAJngMHH0mrHspXdrV6eMnl7Uiu9KbvUfswWCgNkioumRBUdiXUWMjGWBNzxuP5dJ+K6B3aIs9Qfci/VX4yiMOnvIVOmjyrjf7D3XgxVhh9kBaV7Bax0WsbPMSEdekt6K4YetTFyB4gbiTz/pQrmfoCQSaXDnKMJt0fKjcbSWOdIgB7qKSMTPczNfQswkIEReYZ0D/kn9O3vNp7Qu80deA72LguCrQicl3PvRJQUKRfW062Ftl5fp+4EcxKMNig6CvgC7hcSuU7qvdHv5pYf5ZleutK0WJmgur2mNPH/2UEDUS1O5CJMawWQMwjGr4X6hZ7TNj/60ktDoKjNj/D9C0bvmfp4jptvxVEV7RCbJEVVpaGO9Bs1FDSOJwnG/6e0PjrcfUs72fPqwQqr3437g3Fs= smithi179.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTjXEtPy6K3SVplMrI6TALkSRYGeeAMeoKfdtuYBVXFzhhQhJ21NLdNzMMcwYmCfqmu7nEjh5dMv/USnuVdwDz3nr+MttdDrHV6WGmi3XnkeHknhwLXHcnjckYJUYxJwiCW1x6wRJJ89CWxAcLt+0Gd7xBrl3jQxnai7LfNt5Y0hfgsJqENm8WgQoM0/Co+sB5scpwRwFLSbwFNeRQZFxKwlqxRF54ptQ+GmMYGHqsIixiCY2ImHmdDDdnJu5WQaI4D9jQEeDtTI9VVZn+X3ur3/WcVaFQtF2OEaxEWxsoMYq9bIFGdsw7Pl0KVg+nju9jwxkjLg/fMUUgDPpgm8yf9EnlBJvxe32f3W7tObIgLdS7+aD9XzXOLA/oUUCWvJIjjSSa+3kRzZCDlbtZchfObmKxgztZ1nJW47Ft6tPKCF6+tl3BczAs6w+veEPo5GNuI3f0u2N7i93+a2oHNpVDgKVnQ6zcz4hcxh5CJs0g07QRHP7nB4Z6HmBdSaAwlN0= 2021-10-13T04:14:26.872 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-10-13T04:14:26.932 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-10-13T04:14:26.942 INFO:teuthology.task.internal:Saving configuration 2021-10-13T04:14:26.978 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-10-13T04:14:26.990 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-13T04:14:27.016 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-12_12:50:50-rados-wip-yuri7-testing-2021-10-08-0924-distro-basic-smithi/6433623', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-13 04:09:29.798138', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBICUoyvfL2ul+Eu6MCTOef6tNKXBISi15+GJlCv7XWv6oqcoobzoaww4jMHrUWKHt/vku6emCuwDW9KkbtuvGPY='} 2021-10-13T04:14:27.043 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-12_12:50:50-rados-wip-yuri7-testing-2021-10-08-0924-distro-basic-smithi/6433623', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-13 04:09:29.798159', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8tw3oe653zB0govJHsvdt+f2qHJ5zArrEPRqpDwbAc0Ebx8LW9t6A6utgLeCksaibqTYrSIrB9MqCsORLzNvI='} 2021-10-13T04:14:27.044 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-10-13T04:14:27.054 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-10-13T04:14:27.055 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-10-13T04:14:27.055 INFO:teuthology.run_tasks:Running task console_log... 2021-10-13T04:14:27.149 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8407638620>, signals=[15]) 2021-10-13T04:14:27.152 INFO:teuthology.run_tasks:Running task internal.connect... 2021-10-13T04:14:27.162 INFO:teuthology.task.internal:Opening connections... 2021-10-13T04:14:27.163 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2021-10-13T04:14:27.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:14:27.238 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2021-10-13T04:14:27.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-13T04:14:27.316 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-10-13T04:14:27.327 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2021-10-13T04:14:27.344 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2021-10-13T04:14:27.344 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2021-10-13T04:14:27.399 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Linux" 2021-10-13T04:14:27.399 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2021-10-13T04:14:27.399 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2021-10-13T04:14:27.400 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2021-10-13T04:14:27.400 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2021-10-13T04:14:27.400 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2021-10-13T04:14:27.400 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-13T04:14:27.400 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2021-10-13T04:14:27.401 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-13T04:14:27.401 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2021-10-13T04:14:27.401 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-13T04:14:27.402 INFO:teuthology.orchestra.run.smithi179.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-13T04:14:27.402 INFO:teuthology.orchestra.run.smithi179.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-13T04:14:27.402 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2021-10-13T04:14:27.421 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2021-10-13T04:14:27.437 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2021-10-13T04:14:27.437 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2021-10-13T04:14:27.493 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Linux" 2021-10-13T04:14:27.494 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2021-10-13T04:14:27.494 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2021-10-13T04:14:27.495 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2021-10-13T04:14:27.495 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2021-10-13T04:14:27.496 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2021-10-13T04:14:27.496 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-13T04:14:27.497 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2021-10-13T04:14:27.497 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-13T04:14:27.497 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2021-10-13T04:14:27.498 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-13T04:14:27.498 INFO:teuthology.orchestra.run.smithi045.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-13T04:14:27.499 INFO:teuthology.orchestra.run.smithi045.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-13T04:14:27.499 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2021-10-13T04:14:27.520 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-10-13T04:14:27.536 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-10-13T04:14:27.556 INFO:teuthology.task.internal:Checking for old test directory... 2021-10-13T04:14:27.557 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2021-10-13T04:14:27.560 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2021-10-13T04:14:27.575 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-10-13T04:14:27.598 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-10-13T04:14:27.598 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2021-10-13T04:14:27.615 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2021-10-13T04:14:27.646 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-10-13T04:14:27.698 INFO:teuthology.run_tasks:Running task kernel... 2021-10-13T04:14:27.714 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-10-13T04:14:27.715 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-10-13T04:14:27.715 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-10-13T04:14:27.716 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2021-10-13T04:14:27.729 INFO:teuthology.orchestra.run.smithi179.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-10-13T04:14:27.730 INFO:teuthology.task.kernel:Running kernel on smithi179: 4.18.0-305.10.2.el8_4.x86_64 2021-10-13T04:14:27.730 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum install -y kernel 2021-10-13T04:14:30.623 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-8 - AppStream 12 MB/s | 9.3 MB 00:00 2021-10-13T04:14:32.266 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-8 - Base 36 MB/s | 7.5 MB 00:00 2021-10-13T04:14:33.367 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-8 - Extras 128 kB/s | 10 kB 00:00 2021-10-13T04:14:44.879 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Linux 8 - AppStream 828 kB/s | 9.3 MB 00:11 2021-10-13T04:14:48.196 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Linux 8 - BaseOS 4.0 MB/s | 7.5 MB 00:01 2021-10-13T04:14:49.456 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Linux 8 - Extras 44 kB/s | 10 kB 00:00 2021-10-13T04:14:49.746 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-8 - PowerTools 10 MB/s | 2.4 MB 00:00 2021-10-13T04:14:52.342 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2021-10-13T04:14:53.442 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 10 MB/s | 10 MB 00:01 2021-10-13T04:14:55.676 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2021-10-13T04:14:57.733 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-10-13T04:14:57.733 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-10-13T04:14:58.055 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2021-10-13T04:14:58.056 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2021-10-13T04:14:58.056 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2021-10-13T04:14:58.056 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2021-10-13T04:14:58.056 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2021-10-13T04:14:58.057 INFO:teuthology.orchestra.run.smithi179.stdout: kernel x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 5.9 M 2021-10-13T04:14:58.057 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2021-10-13T04:14:58.057 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 36 M 2021-10-13T04:14:58.057 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 28 M 2021-10-13T04:14:58.058 INFO:teuthology.orchestra.run.smithi179.stdout: 2021-10-13T04:14:58.058 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2021-10-13T04:14:58.058 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2021-10-13T04:14:58.058 INFO:teuthology.orchestra.run.smithi179.stdout:Install 3 Packages 2021-10-13T04:14:58.058 INFO:teuthology.orchestra.run.smithi179.stdout: 2021-10-13T04:14:58.059 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 70 M 2021-10-13T04:14:58.059 INFO:teuthology.orchestra.run.smithi179.stdout:Installed size: 88 M 2021-10-13T04:14:58.060 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2021-10-13T04:14:58.228 INFO:teuthology.orchestra.run.smithi179.stdout:(1/3): kernel-4.18.0-305.19.1.el8_4.x86_64.rpm 35 MB/s | 5.9 MB 00:00 2021-10-13T04:14:58.865 INFO:teuthology.orchestra.run.smithi179.stdout:(2/3): kernel-modules-4.18.0-305.19.1.el8_4.x86 35 MB/s | 28 MB 00:00 2021-10-13T04:14:59.391 INFO:teuthology.orchestra.run.smithi179.stdout:(3/3): kernel-core-4.18.0-305.19.1.el8_4.x86_64 27 MB/s | 36 MB 00:01 2021-10-13T04:14:59.396 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2021-10-13T04:14:59.396 INFO:teuthology.orchestra.run.smithi179.stdout:Total 52 MB/s | 70 MB 00:01 2021-10-13T04:14:59.509 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2021-10-13T04:14:59.851 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2021-10-13T04:14:59.852 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2021-10-13T04:15:01.055 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2021-10-13T04:15:01.070 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2021-10-13T04:15:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2021-10-13T04:15:04.024 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-13T04:15:07.272 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-13T04:15:07.598 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-13T04:15:10.567 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-13T04:15:10.801 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-13T04:15:31.324 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-13T04:15:31.656 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-13T04:15:31.657 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-13T04:15:31.657 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-core-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-13T04:15:32.068 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-13T04:15:32.068 INFO:teuthology.orchestra.run.smithi179.stdout: 2021-10-13T04:15:32.069 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2021-10-13T04:15:32.069 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:15:32.069 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core-4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:15:32.069 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:15:32.070 INFO:teuthology.orchestra.run.smithi179.stdout: 2021-10-13T04:15:32.070 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2021-10-13T04:15:32.124 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel --last | head -n 1 2021-10-13T04:15:32.264 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Wed 13 Oct 2021 04:15:10 AM UTC 2021-10-13T04:15:32.266 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:15:32.267 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:15:32.267 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2021-10-13T04:15:32.286 INFO:teuthology.orchestra.run.smithi045.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-10-13T04:15:32.286 INFO:teuthology.task.kernel:Running kernel on smithi045: 4.18.0-305.10.2.el8_4.x86_64 2021-10-13T04:15:32.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum install -y kernel 2021-10-13T04:15:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-8 - AppStream 35 MB/s | 9.3 MB 00:00 2021-10-13T04:15:36.353 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-8 - Base 39 MB/s | 7.5 MB 00:00 2021-10-13T04:15:37.491 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-8 - Extras 159 kB/s | 10 kB 00:00 2021-10-13T04:15:40.512 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Linux 8 - AppStream 3.1 MB/s | 9.3 MB 00:02 2021-10-13T04:15:44.620 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Linux 8 - BaseOS 2.9 MB/s | 7.5 MB 00:02 2021-10-13T04:15:45.845 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Linux 8 - Extras 74 kB/s | 10 kB 00:00 2021-10-13T04:15:46.009 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-8 - PowerTools 22 MB/s | 2.4 MB 00:00 2021-10-13T04:15:48.647 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2021-10-13T04:15:49.720 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 10 MB/s | 10 MB 00:01 2021-10-13T04:15:52.065 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2021-10-13T04:15:54.226 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-10-13T04:15:54.227 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-10-13T04:15:54.564 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2021-10-13T04:15:54.566 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2021-10-13T04:15:54.566 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2021-10-13T04:15:54.566 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2021-10-13T04:15:54.566 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2021-10-13T04:15:54.567 INFO:teuthology.orchestra.run.smithi045.stdout: kernel x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 5.9 M 2021-10-13T04:15:54.567 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2021-10-13T04:15:54.567 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-core x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 36 M 2021-10-13T04:15:54.567 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 28 M 2021-10-13T04:15:54.568 INFO:teuthology.orchestra.run.smithi045.stdout: 2021-10-13T04:15:54.568 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2021-10-13T04:15:54.568 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2021-10-13T04:15:54.568 INFO:teuthology.orchestra.run.smithi045.stdout:Install 3 Packages 2021-10-13T04:15:54.568 INFO:teuthology.orchestra.run.smithi045.stdout: 2021-10-13T04:15:54.569 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 70 M 2021-10-13T04:15:54.569 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 88 M 2021-10-13T04:15:54.569 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2021-10-13T04:15:54.841 INFO:teuthology.orchestra.run.smithi045.stdout:(1/3): kernel-4.18.0-305.19.1.el8_4.x86_64.rpm 22 MB/s | 5.9 MB 00:00 2021-10-13T04:15:55.609 INFO:teuthology.orchestra.run.smithi045.stdout:(2/3): kernel-core-4.18.0-305.19.1.el8_4.x86_64 34 MB/s | 36 MB 00:01 2021-10-13T04:15:56.067 INFO:teuthology.orchestra.run.smithi045.stdout:(3/3): kernel-modules-4.18.0-305.19.1.el8_4.x86 19 MB/s | 28 MB 00:01 2021-10-13T04:15:56.070 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2021-10-13T04:15:56.071 INFO:teuthology.orchestra.run.smithi045.stdout:Total 46 MB/s | 70 MB 00:01 2021-10-13T04:15:56.187 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2021-10-13T04:15:56.529 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2021-10-13T04:15:56.530 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2021-10-13T04:15:57.757 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2021-10-13T04:15:57.775 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2021-10-13T04:16:00.397 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2021-10-13T04:16:00.907 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-13T04:16:04.307 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-13T04:16:04.690 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-13T04:16:07.887 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-13T04:16:08.456 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-13T04:16:30.651 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-13T04:16:30.963 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-13T04:16:30.964 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-13T04:16:30.964 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-core-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-13T04:16:31.431 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-13T04:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: 2021-10-13T04:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2021-10-13T04:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-core-4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout: 2021-10-13T04:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2021-10-13T04:16:31.494 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel --last | head -n 1 2021-10-13T04:16:31.649 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Wed 13 Oct 2021 04:16:07 AM UTC 2021-10-13T04:16:31.651 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:31.651 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:31.652 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-10-13T04:16:31.652 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-13T04:16:31.652 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-13T04:16:31.652 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-10-13T04:16:31.653 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2021-10-13T04:16:31.653 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel --last | head -n 1 2021-10-13T04:16:31.794 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Wed 13 Oct 2021 04:15:10 AM UTC 2021-10-13T04:16:31.796 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:31.797 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2021-10-13T04:16:31.827 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2021-10-13T04:16:31.827 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2021-10-13T04:16:31.827 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.02 2021-10-13T04:16:31.827 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 90.el8 2021-10-13T04:16:31.828 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2021-10-13T04:16:31.828 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Wed 11 Aug 2021 06:38:04 PM UTC 2021-10-13T04:16:31.828 INFO:teuthology.orchestra.run.smithi179.stdout:Group : System Environment/Base 2021-10-13T04:16:31.828 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 9197207 2021-10-13T04:16:31.829 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2021-10-13T04:16:31.829 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-10-13T04:16:31.829 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-10-13T04:16:31.829 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-10-13T04:16:31.829 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : kbuilder.bsys.centos.org 2021-10-13T04:16:31.830 INFO:teuthology.orchestra.run.smithi179.stdout:Relocations : (not relocatable) 2021-10-13T04:16:31.830 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : CentOS BuildSystem 2021-10-13T04:16:31.830 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : CentOS 2021-10-13T04:16:31.830 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2021-10-13T04:16:31.831 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2021-10-13T04:16:31.831 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2021-10-13T04:16:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: 2021-10-13T04:16:31.831 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-10-13T04:16:31.831 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2021-10-13T04:16:31.832 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2021-10-13T04:16:31.832 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2021-10-13T04:16:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: 2021-10-13T04:16:31.832 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2021-10-13T04:16:31.833 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-10-13T04:16:31.834 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:31.834 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-10-13T04:16:32.534 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2021-10-13T04:16:35.356 INFO:teuthology.orchestra.run.smithi179.stderr:done 2021-10-13T04:16:35.358 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2021-10-13T04:16:35.416 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.XJQyt8YDxL 2021-10-13T04:16:35.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XJQyt8YDxL 2021-10-13T04:16:35.446 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.XJQyt8YDxL 2021-10-13T04:16:35.600 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.XJQyt8YDxL is 6KB 2021-10-13T04:16:35.648 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.XJQyt8YDxL 2021-10-13T04:16:35.662 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2021-10-13T04:16:35.734 INFO:teuthology.orchestra.run.smithi179.stdout:ecc66dffcd264e5181894e69c53ff13c-0-rescue.conf 2021-10-13T04:16:35.734 INFO:teuthology.orchestra.run.smithi179.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-240.el8.x86_64.conf 2021-10-13T04:16:35.734 INFO:teuthology.orchestra.run.smithi179.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.10.2.el8_4.x86_64.conf 2021-10-13T04:16:35.735 INFO:teuthology.orchestra.run.smithi179.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64.conf 2021-10-13T04:16:35.736 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:35.904 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2021-10-13T04:16:35.906 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-10-13T04:16:35.906 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=None, version=distro) 2021-10-13T04:16:35.906 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel --last | head -n 1 2021-10-13T04:16:36.053 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Wed 13 Oct 2021 04:16:07 AM UTC 2021-10-13T04:16:36.054 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:36.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -qi grub2-tools 2021-10-13T04:16:36.086 INFO:teuthology.orchestra.run.smithi045.stdout:Name : grub2-tools 2021-10-13T04:16:36.086 INFO:teuthology.orchestra.run.smithi045.stdout:Epoch : 1 2021-10-13T04:16:36.087 INFO:teuthology.orchestra.run.smithi045.stdout:Version : 2.02 2021-10-13T04:16:36.087 INFO:teuthology.orchestra.run.smithi045.stdout:Release : 90.el8 2021-10-13T04:16:36.087 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: x86_64 2021-10-13T04:16:36.087 INFO:teuthology.orchestra.run.smithi045.stdout:Install Date: Wed 11 Aug 2021 06:38:04 PM UTC 2021-10-13T04:16:36.088 INFO:teuthology.orchestra.run.smithi045.stdout:Group : System Environment/Base 2021-10-13T04:16:36.088 INFO:teuthology.orchestra.run.smithi045.stdout:Size : 9197207 2021-10-13T04:16:36.088 INFO:teuthology.orchestra.run.smithi045.stdout:License : GPLv3+ 2021-10-13T04:16:36.088 INFO:teuthology.orchestra.run.smithi045.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-10-13T04:16:36.088 INFO:teuthology.orchestra.run.smithi045.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-10-13T04:16:36.089 INFO:teuthology.orchestra.run.smithi045.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-10-13T04:16:36.089 INFO:teuthology.orchestra.run.smithi045.stdout:Build Host : kbuilder.bsys.centos.org 2021-10-13T04:16:36.089 INFO:teuthology.orchestra.run.smithi045.stdout:Relocations : (not relocatable) 2021-10-13T04:16:36.089 INFO:teuthology.orchestra.run.smithi045.stdout:Packager : CentOS BuildSystem 2021-10-13T04:16:36.089 INFO:teuthology.orchestra.run.smithi045.stdout:Vendor : CentOS 2021-10-13T04:16:36.090 INFO:teuthology.orchestra.run.smithi045.stdout:URL : http://www.gnu.org/software/grub/ 2021-10-13T04:16:36.090 INFO:teuthology.orchestra.run.smithi045.stdout:Summary : Support tools for GRUB. 2021-10-13T04:16:36.090 INFO:teuthology.orchestra.run.smithi045.stdout:Description : 2021-10-13T04:16:36.090 INFO:teuthology.orchestra.run.smithi045.stdout: 2021-10-13T04:16:36.091 INFO:teuthology.orchestra.run.smithi045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-10-13T04:16:36.091 INFO:teuthology.orchestra.run.smithi045.stdout:customizable bootloader with modular architecture. It supports a rich 2021-10-13T04:16:36.091 INFO:teuthology.orchestra.run.smithi045.stdout:variety of kernel formats, file systems, computer architectures and 2021-10-13T04:16:36.091 INFO:teuthology.orchestra.run.smithi045.stdout:hardware devices. 2021-10-13T04:16:36.091 INFO:teuthology.orchestra.run.smithi045.stdout: 2021-10-13T04:16:36.092 INFO:teuthology.orchestra.run.smithi045.stdout:This subpackage provides tools for support of all platforms. 2021-10-13T04:16:36.092 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-10-13T04:16:36.093 INFO:teuthology.task.kernel:Updating grub on smithi045 to boot 4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:36.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-10-13T04:16:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2021-10-13T04:16:39.555 INFO:teuthology.orchestra.run.smithi045.stderr:done 2021-10-13T04:16:39.557 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2021-10-13T04:16:39.584 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.k4K4zs1cQ5 2021-10-13T04:16:39.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.k4K4zs1cQ5 2021-10-13T04:16:39.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.k4K4zs1cQ5 2021-10-13T04:16:39.818 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.k4K4zs1cQ5 is 6KB 2021-10-13T04:16:39.867 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.k4K4zs1cQ5 2021-10-13T04:16:39.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo /bin/ls /boot/loader/entries || true 2021-10-13T04:16:39.944 INFO:teuthology.orchestra.run.smithi045.stdout:ecc66dffcd264e5181894e69c53ff13c-0-rescue.conf 2021-10-13T04:16:39.944 INFO:teuthology.orchestra.run.smithi045.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-240.el8.x86_64.conf 2021-10-13T04:16:39.944 INFO:teuthology.orchestra.run.smithi045.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.10.2.el8_4.x86_64.conf 2021-10-13T04:16:39.944 INFO:teuthology.orchestra.run.smithi045.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64.conf 2021-10-13T04:16:39.945 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-set-default ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64 2021-10-13T04:16:40.095 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2021-10-13T04:16:42.090 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-10-13T04:16:42.091 DEBUG:teuthology.task.console_log:Killing console logger for smithi179 2021-10-13T04:16:42.092 DEBUG:teuthology.task.console_log:Killing console logger for smithi045 2021-10-13T04:16:42.092 DEBUG:teuthology.task.console_log:Killing console logger for smithi179 2021-10-13T04:16:42.093 DEBUG:teuthology.task.console_log:Killing console logger for smithi045 2021-10-13T04:16:42.093 DEBUG:teuthology.exit:Finished running handlers