Found 100 jobs Ignoring malparsed backtrace: ceph version 16.0.0-4625-g5b080e60b3a (5b080e60b3a864892f15f47b8840772b1475ecfc) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f523c87e9d8] , 2: (()+0x276bf2) [0x7f523c87ebf2] Ignoring malparsed backtrace: 2020-08-23T11:50:51.066 INFO:teuthology.orchestra.run.smithi200:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T11:50:51.198 INFO:teuthology.orchestra.run.smithi200.stdout:{ , 2020-08-23T11:50:51.198 INFO:teuthology.orchestra.run.smithi200.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2020-08-23T11:50:54.429 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.429 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2020-08-23T11:50:14.469283+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.429 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2020-08-23T11:49:56.679487+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=49, tm_sec=56, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:50:54.446 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2020-08-23T11:50:00.704301+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.446 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-08-23T11:50:04.418634+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.446 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-08-23T11:50:09.435888+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:14.795 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2020-08-23T11:49:56.679487+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=49, tm_sec=56, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.796 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2020-08-23T11:49:52.651986+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=49, tm_sec=52, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.796 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2020-08-23T11:50:00.704301+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:14.809 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T11:50:04.418634+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.809 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2020-08-23T11:50:09.435888+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.810 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:35.174 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2020-08-23T11:50:09.435888+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.174 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.174 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-08-23T11:50:14.469283+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:35.192 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2020-08-23T11:50:00.704301+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.192 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2020-08-23T11:50:04.418634+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.192 INFO:tasks.ceph:pgid 10.1d last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:52:15.577 INFO:teuthology.orchestra.run.smithi200:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-08-23T11:52:15.872 INFO:teuthology.orchestra.run.smithi200.stdout: , dumped all Ignoring malparsed backtrace: 2020-08-23T11:53:17.590 INFO:teuthology.orchestra.run:waiting for 300 , 2020-08-23T11:53:17.658 INFO:tasks.ceph.osd.5:Stopped , 2020-08-23T11:53:17.659 DEBUG:tasks.ceph.osd.6:waiting for process to exit Ignoring malparsed backtrace: 2020-08-23T11:53:29.688 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise , 2020-08-23T11:53:29.688 INFO:teuthology.orchestra.run.smithi190:> sudo lsb_release -is , 2020-08-23T11:53:29.689 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. Ignoring malparsed backtrace: 2020-08-23T11:53:31.515 INFO:teuthology.orchestra.run.smithi200.stdout:Installed products updated. , 2020-08-23T11:53:31.611 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/1 , 2020-08-23T11:53:31.611 INFO:teuthology.orchestra.run.smithi190.stdout:Installed products updated. Ignoring malparsed backtrace: 2020-08-23T11:53:35.146 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test , 2020-08-23T11:53:35.166 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : ceph-test-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/5 , 2020-08-23T11:53:35.167 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 Ignoring malparsed backtrace: 2020-08-23T11:53:39.448 INFO:teuthology.orchestra.run.smithi190.stdout:Removing: , 2020-08-23T11:53:39.448 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:16.0.0-4625.g5b080e60b3a.el8 @ceph 0 , 2020-08-23T11:53:39.448 INFO:teuthology.orchestra.run.smithi190.stdout:Removing unused dependencies: Ignoring malparsed backtrace: 2020-08-23T11:53:42.879 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:53:42.879 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:53:42.879 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 Ignoring malparsed backtrace: 2020-08-23T11:53:43.752 INFO:teuthology.orchestra.run.smithi200.stdout: python3-waitress noarch 1.2.1-2.el8.1 @epel 1.0 M , 2020-08-23T11:53:43.752 INFO:teuthology.orchestra.run.smithi200.stdout: python3-webencodings noarch 0.5.1-6.el8 @rhel-8-for-x86_64-appstream-rpms 72 k , 2020-08-23T11:53:43.752 INFO:teuthology.orchestra.run.smithi200.stdout: python3-webob noarch 1.8.5-1.el8.1 @epel 1.2 M Ignoring malparsed backtrace: 2020-08-23T11:53:43.911 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 1.14.1-5.el8 @epel 82 k , 2020-08-23T11:53:43.911 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme noarch 0.5.2-4.el8 @epel 51 k , 2020-08-23T11:53:43.911 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress noarch 1.2.1-2.el8.1 @epel 1.0 M Ignoring malparsed backtrace: 2020-08-23T11:53:44.689 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 @rhel-8-for-x86_64-appstream-rpms 56 M , 2020-08-23T11:53:44.689 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 @epel 24 k , 2020-08-23T11:53:44.689 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 @epel 43 k Ignoring malparsed backtrace: 2020-08-23T11:53:48.806 INFO:teuthology.orchestra.run.smithi005.stdout: Erasing : python3-remoto-1.1.4-4.el8.noarch 15/81 , 2020-08-23T11:53:48.806 INFO:teuthology.orchestra.run.smithi005.stdout: Erasing : ceph-mgr-diskprediction-local-2:16.0.0-4625.g5b080 16/81 , 2020-08-23T11:53:48.810 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 18/81 Ignoring malparsed backtrace: 2020-08-23T11:53:54.504 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : python3-logutils-0.3.5-11.el8.noarch 49/81 , 2020-08-23T11:53:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: Erasing : python3-werkzeug-0.12.2-4.el8.noarch 48/81 , 2020-08-23T11:53:54.663 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 50/81 Ignoring malparsed backtrace: 2020-08-23T11:54:12.604 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : openblas-0.3.3-5.el8.x86_64 66/81 , 2020-08-23T11:54:12.698 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 64/81 , 2020-08-23T11:54:12.699 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys Ignoring malparsed backtrace: 2020-08-23T11:54:14.870 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 37/81 , 2020-08-23T11:54:14.870 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 38/81 , 2020-08-23T11:54:14.870 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 39/81 Ignoring malparsed backtrace: 2020-08-23T11:54:15.692 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 47/81 , 2020-08-23T11:54:15.692 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 48/81 , 2020-08-23T11:54:15.693 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/81 Ignoring malparsed backtrace: 2020-08-23T11:54:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 67/81 , 2020-08-23T11:54:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 68/81 , 2020-08-23T11:54:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 69/81 Ignoring malparsed backtrace: 2020-08-23T11:54:18.282 INFO:teuthology.orchestra.run.smithi200.stdout: python3-zc-lockfile-2.0-2.el8.noarch , 2020-08-23T11:54:18.282 INFO:teuthology.orchestra.run.smithi200.stdout: rbd-mirror-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:54:18.282 INFO:teuthology.orchestra.run.smithi200.stdout: Ignoring malparsed backtrace: 2020-08-23T11:54:19.298 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:16.0.0-4625.g5b080e60b3a.el8.noarch , 2020-08-23T11:54:19.298 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:54:19.298 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.7-6.el8.x86_64 Ignoring malparsed backtrace: Problem: conflicting requests , - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T11:54:20.028 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. Ignoring malparsed backtrace: 2020-08-23T11:54:24.150 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! , 2020-08-23T11:54:24.274 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. , 2020-08-23T11:54:24.572 INFO:teuthology.orchestra.run.smithi200.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-4625.g5b080e60b 1/1 Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:28.727 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T11:54:28.728 INFO:teuthology.orchestra.run.smithi200.stdout:Nothing to do. Ignoring malparsed backtrace: 2020-08-23T11:54:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:No match for argument: ceph-mgr-cephadm , No packages marked for removal. , 2020-08-23T11:54:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. Ignoring malparsed backtrace: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T11:54:34.412 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. , 2020-08-23T11:54:34.414 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================== Ignoring malparsed backtrace: 2020-08-23T11:54:37.356 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. , 2020-08-23T11:54:37.356 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test , 2020-08-23T11:54:37.390 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:41.571 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T11:54:41.572 INFO:teuthology.orchestra.run.smithi200.stdout:Nothing to do. Ignoring malparsed backtrace: 2020-08-23T11:54:43.524 INFO:teuthology.orchestra.run.smithi200.stdout: Running scriptlet: librados2-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 5/7 , 2020-08-23T11:54:43.524 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. , 2020-08-23T11:54:43.646 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : rbd-nbd-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/7 Ignoring malparsed backtrace: 2020-08-23T11:54:46.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 6/7 , 2020-08-23T11:54:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 7/7 , 2020-08-23T11:54:46.929 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:50.430 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T11:54:50.431 INFO:teuthology.orchestra.run.smithi200.stdout:Nothing to do. Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:53.909 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. , 2020-08-23T11:54:53.910 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. Ignoring malparsed backtrace: 2020-08-23T11:54:59.182 INFO:teuthology.orchestra.run.smithi190:> sudo lsb_release -is , 2020-08-23T11:54:59.183 INFO:teuthology.orchestra.run.smithi005:> sudo lsb_release -is , 2020-08-23T11:54:59.235 INFO:teuthology.orchestra.run.smithi200.stdout:RedHatEnterprise Ignoring malparsed backtrace: 2020-08-23T11:55:02.632 INFO:teuthology.orchestra.run.smithi200:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . , 2020-08-23T11:55:02.674 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/trociny-2020-08-23_07:21:43-rbd-wip-mgolub-testing-distro-basic-smithi/5369093/remote/smithi190 , 2020-08-23T11:55:02.674 INFO:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . Ignoring malparsed backtrace: ceph version 16.0.0-4625-g5b080e60b3a (5b080e60b3a864892f15f47b8840772b1475ecfc) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f523c87e9d8] , 2: (()+0x276bf2) [0x7f523c87ebf2] Ignoring malparsed backtrace: 2020-08-23T11:50:51.066 INFO:teuthology.orchestra.run.smithi200:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T11:50:51.198 INFO:teuthology.orchestra.run.smithi200.stdout:{ , 2020-08-23T11:50:51.198 INFO:teuthology.orchestra.run.smithi200.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2020-08-23T11:50:54.429 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.429 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2020-08-23T11:50:14.469283+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.429 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2020-08-23T11:49:56.679487+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=49, tm_sec=56, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:50:54.446 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2020-08-23T11:50:00.704301+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.446 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-08-23T11:50:04.418634+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.446 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-08-23T11:50:09.435888+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:14.795 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2020-08-23T11:49:56.679487+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=49, tm_sec=56, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.796 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2020-08-23T11:49:52.651986+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=49, tm_sec=52, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.796 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2020-08-23T11:50:00.704301+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:14.809 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T11:50:04.418634+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.809 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2020-08-23T11:50:09.435888+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.810 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:35.174 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2020-08-23T11:50:09.435888+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.174 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.174 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-08-23T11:50:14.469283+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:35.192 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2020-08-23T11:50:00.704301+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.192 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2020-08-23T11:50:04.418634+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.192 INFO:tasks.ceph:pgid 10.1d last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:52:15.577 INFO:teuthology.orchestra.run.smithi200:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-08-23T11:52:15.872 INFO:teuthology.orchestra.run.smithi200.stdout: , dumped all Ignoring malparsed backtrace: 2020-08-23T11:53:17.590 INFO:teuthology.orchestra.run:waiting for 300 , 2020-08-23T11:53:17.658 INFO:tasks.ceph.osd.5:Stopped , 2020-08-23T11:53:17.659 DEBUG:tasks.ceph.osd.6:waiting for process to exit Ignoring malparsed backtrace: 2020-08-23T11:53:29.688 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise , 2020-08-23T11:53:29.688 INFO:teuthology.orchestra.run.smithi190:> sudo lsb_release -is , 2020-08-23T11:53:29.689 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. Ignoring malparsed backtrace: 2020-08-23T11:53:31.515 INFO:teuthology.orchestra.run.smithi200.stdout:Installed products updated. , 2020-08-23T11:53:31.611 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/1 , 2020-08-23T11:53:31.611 INFO:teuthology.orchestra.run.smithi190.stdout:Installed products updated. Ignoring malparsed backtrace: 2020-08-23T11:53:35.146 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test , 2020-08-23T11:53:35.166 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : ceph-test-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/5 , 2020-08-23T11:53:35.167 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 Ignoring malparsed backtrace: 2020-08-23T11:53:39.448 INFO:teuthology.orchestra.run.smithi190.stdout:Removing: , 2020-08-23T11:53:39.448 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:16.0.0-4625.g5b080e60b3a.el8 @ceph 0 , 2020-08-23T11:53:39.448 INFO:teuthology.orchestra.run.smithi190.stdout:Removing unused dependencies: Ignoring malparsed backtrace: 2020-08-23T11:53:42.879 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:53:42.879 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:53:42.879 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 Ignoring malparsed backtrace: 2020-08-23T11:53:43.752 INFO:teuthology.orchestra.run.smithi200.stdout: python3-waitress noarch 1.2.1-2.el8.1 @epel 1.0 M , 2020-08-23T11:53:43.752 INFO:teuthology.orchestra.run.smithi200.stdout: python3-webencodings noarch 0.5.1-6.el8 @rhel-8-for-x86_64-appstream-rpms 72 k , 2020-08-23T11:53:43.752 INFO:teuthology.orchestra.run.smithi200.stdout: python3-webob noarch 1.8.5-1.el8.1 @epel 1.2 M Ignoring malparsed backtrace: 2020-08-23T11:53:43.911 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 1.14.1-5.el8 @epel 82 k , 2020-08-23T11:53:43.911 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme noarch 0.5.2-4.el8 @epel 51 k , 2020-08-23T11:53:43.911 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress noarch 1.2.1-2.el8.1 @epel 1.0 M Ignoring malparsed backtrace: 2020-08-23T11:53:44.689 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 @rhel-8-for-x86_64-appstream-rpms 56 M , 2020-08-23T11:53:44.689 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 @epel 24 k , 2020-08-23T11:53:44.689 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 @epel 43 k Ignoring malparsed backtrace: 2020-08-23T11:53:48.806 INFO:teuthology.orchestra.run.smithi005.stdout: Erasing : python3-remoto-1.1.4-4.el8.noarch 15/81 , 2020-08-23T11:53:48.806 INFO:teuthology.orchestra.run.smithi005.stdout: Erasing : ceph-mgr-diskprediction-local-2:16.0.0-4625.g5b080 16/81 , 2020-08-23T11:53:48.810 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 18/81 Ignoring malparsed backtrace: 2020-08-23T11:53:54.504 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : python3-logutils-0.3.5-11.el8.noarch 49/81 , 2020-08-23T11:53:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: Erasing : python3-werkzeug-0.12.2-4.el8.noarch 48/81 , 2020-08-23T11:53:54.663 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 50/81 Ignoring malparsed backtrace: 2020-08-23T11:54:12.604 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : openblas-0.3.3-5.el8.x86_64 66/81 , 2020-08-23T11:54:12.698 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 64/81 , 2020-08-23T11:54:12.699 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys Ignoring malparsed backtrace: 2020-08-23T11:54:14.870 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 37/81 , 2020-08-23T11:54:14.870 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 38/81 , 2020-08-23T11:54:14.870 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 39/81 Ignoring malparsed backtrace: 2020-08-23T11:54:15.692 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 47/81 , 2020-08-23T11:54:15.692 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 48/81 , 2020-08-23T11:54:15.693 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/81 Ignoring malparsed backtrace: 2020-08-23T11:54:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 67/81 , 2020-08-23T11:54:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 68/81 , 2020-08-23T11:54:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 69/81 Ignoring malparsed backtrace: 2020-08-23T11:54:18.282 INFO:teuthology.orchestra.run.smithi200.stdout: python3-zc-lockfile-2.0-2.el8.noarch , 2020-08-23T11:54:18.282 INFO:teuthology.orchestra.run.smithi200.stdout: rbd-mirror-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:54:18.282 INFO:teuthology.orchestra.run.smithi200.stdout: Ignoring malparsed backtrace: 2020-08-23T11:54:19.298 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:16.0.0-4625.g5b080e60b3a.el8.noarch , 2020-08-23T11:54:19.298 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:54:19.298 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.7-6.el8.x86_64 Ignoring malparsed backtrace: Problem: conflicting requests , - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T11:54:20.028 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. Ignoring malparsed backtrace: 2020-08-23T11:54:24.150 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! , 2020-08-23T11:54:24.274 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. , 2020-08-23T11:54:24.572 INFO:teuthology.orchestra.run.smithi200.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-4625.g5b080e60b 1/1 Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:28.727 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T11:54:28.728 INFO:teuthology.orchestra.run.smithi200.stdout:Nothing to do. Ignoring malparsed backtrace: 2020-08-23T11:54:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:No match for argument: ceph-mgr-cephadm , No packages marked for removal. , 2020-08-23T11:54:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. Ignoring malparsed backtrace: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T11:54:34.412 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. , 2020-08-23T11:54:34.414 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================== Ignoring malparsed backtrace: 2020-08-23T11:54:37.356 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. , 2020-08-23T11:54:37.356 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test , 2020-08-23T11:54:37.390 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:41.571 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T11:54:41.572 INFO:teuthology.orchestra.run.smithi200.stdout:Nothing to do. Ignoring malparsed backtrace: 2020-08-23T11:54:43.524 INFO:teuthology.orchestra.run.smithi200.stdout: Running scriptlet: librados2-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 5/7 , 2020-08-23T11:54:43.524 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. , 2020-08-23T11:54:43.646 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : rbd-nbd-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/7 Ignoring malparsed backtrace: 2020-08-23T11:54:46.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 6/7 , 2020-08-23T11:54:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 7/7 , 2020-08-23T11:54:46.929 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:50.430 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T11:54:50.431 INFO:teuthology.orchestra.run.smithi200.stdout:Nothing to do. Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:53.909 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. , 2020-08-23T11:54:53.910 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. Ignoring malparsed backtrace: 2020-08-23T11:54:59.182 INFO:teuthology.orchestra.run.smithi190:> sudo lsb_release -is , 2020-08-23T11:54:59.183 INFO:teuthology.orchestra.run.smithi005:> sudo lsb_release -is , 2020-08-23T11:54:59.235 INFO:teuthology.orchestra.run.smithi200.stdout:RedHatEnterprise Ignoring malparsed backtrace: 2020-08-23T11:55:02.632 INFO:teuthology.orchestra.run.smithi200:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . , 2020-08-23T11:55:02.674 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/trociny-2020-08-23_07:21:43-rbd-wip-mgolub-testing-distro-basic-smithi/5369093/remote/smithi190 , 2020-08-23T11:55:02.674 INFO:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . Ignoring malparsed backtrace: ceph version 16.0.0-4625-g5b080e60b3a (5b080e60b3a864892f15f47b8840772b1475ecfc) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f523c87e9d8] , 2: (()+0x276bf2) [0x7f523c87ebf2] Ignoring malparsed backtrace: 2020-08-23T11:50:51.066 INFO:teuthology.orchestra.run.smithi200:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T11:50:51.198 INFO:teuthology.orchestra.run.smithi200.stdout:{ , 2020-08-23T11:50:51.198 INFO:teuthology.orchestra.run.smithi200.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2020-08-23T11:50:54.429 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.429 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2020-08-23T11:50:14.469283+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.429 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2020-08-23T11:49:56.679487+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=49, tm_sec=56, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:50:54.446 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2020-08-23T11:50:00.704301+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.446 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-08-23T11:50:04.418634+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:50:54.446 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-08-23T11:50:09.435888+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:14.795 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2020-08-23T11:49:56.679487+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=49, tm_sec=56, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.796 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2020-08-23T11:49:52.651986+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=49, tm_sec=52, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.796 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2020-08-23T11:50:00.704301+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:14.809 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2020-08-23T11:50:04.418634+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.809 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2020-08-23T11:50:09.435888+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:14.810 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:35.174 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2020-08-23T11:50:09.435888+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=9, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.174 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.174 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-08-23T11:50:14.469283+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:51:35.192 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2020-08-23T11:50:00.704301+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.192 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2020-08-23T11:50:04.418634+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=4, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T11:51:35.192 INFO:tasks.ceph:pgid 10.1d last_scrub_stamp 2020-08-23T11:50:23.413048+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=23, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=11, tm_min=50, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T11:52:15.577 INFO:teuthology.orchestra.run.smithi200:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-08-23T11:52:15.872 INFO:teuthology.orchestra.run.smithi200.stdout: , dumped all Ignoring malparsed backtrace: 2020-08-23T11:53:17.590 INFO:teuthology.orchestra.run:waiting for 300 , 2020-08-23T11:53:17.658 INFO:tasks.ceph.osd.5:Stopped , 2020-08-23T11:53:17.659 DEBUG:tasks.ceph.osd.6:waiting for process to exit Ignoring malparsed backtrace: 2020-08-23T11:53:29.688 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise , 2020-08-23T11:53:29.688 INFO:teuthology.orchestra.run.smithi190:> sudo lsb_release -is , 2020-08-23T11:53:29.689 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. Ignoring malparsed backtrace: 2020-08-23T11:53:31.515 INFO:teuthology.orchestra.run.smithi200.stdout:Installed products updated. , 2020-08-23T11:53:31.611 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/1 , 2020-08-23T11:53:31.611 INFO:teuthology.orchestra.run.smithi190.stdout:Installed products updated. Ignoring malparsed backtrace: 2020-08-23T11:53:35.146 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test , 2020-08-23T11:53:35.166 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : ceph-test-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/5 , 2020-08-23T11:53:35.167 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 Ignoring malparsed backtrace: 2020-08-23T11:53:39.448 INFO:teuthology.orchestra.run.smithi190.stdout:Removing: , 2020-08-23T11:53:39.448 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:16.0.0-4625.g5b080e60b3a.el8 @ceph 0 , 2020-08-23T11:53:39.448 INFO:teuthology.orchestra.run.smithi190.stdout:Removing unused dependencies: Ignoring malparsed backtrace: 2020-08-23T11:53:42.879 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:53:42.879 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:53:42.879 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 Ignoring malparsed backtrace: 2020-08-23T11:53:43.752 INFO:teuthology.orchestra.run.smithi200.stdout: python3-waitress noarch 1.2.1-2.el8.1 @epel 1.0 M , 2020-08-23T11:53:43.752 INFO:teuthology.orchestra.run.smithi200.stdout: python3-webencodings noarch 0.5.1-6.el8 @rhel-8-for-x86_64-appstream-rpms 72 k , 2020-08-23T11:53:43.752 INFO:teuthology.orchestra.run.smithi200.stdout: python3-webob noarch 1.8.5-1.el8.1 @epel 1.2 M Ignoring malparsed backtrace: 2020-08-23T11:53:43.911 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 1.14.1-5.el8 @epel 82 k , 2020-08-23T11:53:43.911 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme noarch 0.5.2-4.el8 @epel 51 k , 2020-08-23T11:53:43.911 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress noarch 1.2.1-2.el8.1 @epel 1.0 M Ignoring malparsed backtrace: 2020-08-23T11:53:44.689 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 @rhel-8-for-x86_64-appstream-rpms 56 M , 2020-08-23T11:53:44.689 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 @epel 24 k , 2020-08-23T11:53:44.689 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 @epel 43 k Ignoring malparsed backtrace: 2020-08-23T11:53:48.806 INFO:teuthology.orchestra.run.smithi005.stdout: Erasing : python3-remoto-1.1.4-4.el8.noarch 15/81 , 2020-08-23T11:53:48.806 INFO:teuthology.orchestra.run.smithi005.stdout: Erasing : ceph-mgr-diskprediction-local-2:16.0.0-4625.g5b080 16/81 , 2020-08-23T11:53:48.810 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 18/81 Ignoring malparsed backtrace: 2020-08-23T11:53:54.504 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : python3-logutils-0.3.5-11.el8.noarch 49/81 , 2020-08-23T11:53:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: Erasing : python3-werkzeug-0.12.2-4.el8.noarch 48/81 , 2020-08-23T11:53:54.663 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 50/81 Ignoring malparsed backtrace: 2020-08-23T11:54:12.604 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : openblas-0.3.3-5.el8.x86_64 66/81 , 2020-08-23T11:54:12.698 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 64/81 , 2020-08-23T11:54:12.699 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys Ignoring malparsed backtrace: 2020-08-23T11:54:14.870 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 37/81 , 2020-08-23T11:54:14.870 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 38/81 , 2020-08-23T11:54:14.870 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 39/81 Ignoring malparsed backtrace: 2020-08-23T11:54:15.692 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 47/81 , 2020-08-23T11:54:15.692 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 48/81 , 2020-08-23T11:54:15.693 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/81 Ignoring malparsed backtrace: 2020-08-23T11:54:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 67/81 , 2020-08-23T11:54:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 68/81 , 2020-08-23T11:54:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 69/81 Ignoring malparsed backtrace: 2020-08-23T11:54:18.282 INFO:teuthology.orchestra.run.smithi200.stdout: python3-zc-lockfile-2.0-2.el8.noarch , 2020-08-23T11:54:18.282 INFO:teuthology.orchestra.run.smithi200.stdout: rbd-mirror-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:54:18.282 INFO:teuthology.orchestra.run.smithi200.stdout: Ignoring malparsed backtrace: 2020-08-23T11:54:19.298 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:16.0.0-4625.g5b080e60b3a.el8.noarch , 2020-08-23T11:54:19.298 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T11:54:19.298 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.7-6.el8.x86_64 Ignoring malparsed backtrace: Problem: conflicting requests , - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T11:54:20.028 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. Ignoring malparsed backtrace: 2020-08-23T11:54:24.150 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! , 2020-08-23T11:54:24.274 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. , 2020-08-23T11:54:24.572 INFO:teuthology.orchestra.run.smithi200.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-4625.g5b080e60b 1/1 Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:28.727 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T11:54:28.728 INFO:teuthology.orchestra.run.smithi200.stdout:Nothing to do. Ignoring malparsed backtrace: 2020-08-23T11:54:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:No match for argument: ceph-mgr-cephadm , No packages marked for removal. , 2020-08-23T11:54:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. Ignoring malparsed backtrace: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T11:54:34.412 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. , 2020-08-23T11:54:34.414 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================== Ignoring malparsed backtrace: 2020-08-23T11:54:37.356 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. , 2020-08-23T11:54:37.356 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test , 2020-08-23T11:54:37.390 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:41.571 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T11:54:41.572 INFO:teuthology.orchestra.run.smithi200.stdout:Nothing to do. Ignoring malparsed backtrace: 2020-08-23T11:54:43.524 INFO:teuthology.orchestra.run.smithi200.stdout: Running scriptlet: librados2-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 5/7 , 2020-08-23T11:54:43.524 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. , 2020-08-23T11:54:43.646 INFO:teuthology.orchestra.run.smithi190.stdout: Erasing : rbd-nbd-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/7 Ignoring malparsed backtrace: 2020-08-23T11:54:46.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 6/7 , 2020-08-23T11:54:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 7/7 , 2020-08-23T11:54:46.929 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:50.430 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T11:54:50.431 INFO:teuthology.orchestra.run.smithi200.stdout:Nothing to do. Ignoring malparsed backtrace: No packages marked for removal. , 2020-08-23T11:54:53.909 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. , 2020-08-23T11:54:53.910 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. Ignoring malparsed backtrace: 2020-08-23T11:54:59.182 INFO:teuthology.orchestra.run.smithi190:> sudo lsb_release -is , 2020-08-23T11:54:59.183 INFO:teuthology.orchestra.run.smithi005:> sudo lsb_release -is , 2020-08-23T11:54:59.235 INFO:teuthology.orchestra.run.smithi200.stdout:RedHatEnterprise Ignoring malparsed backtrace: 2020-08-23T11:55:02.632 INFO:teuthology.orchestra.run.smithi200:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . , 2020-08-23T11:55:02.674 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/trociny-2020-08-23_07:21:43-rbd-wip-mgolub-testing-distro-basic-smithi/5369093/remote/smithi190 , 2020-08-23T11:55:02.674 INFO:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . Ignoring malparsed backtrace: ceph version 16.0.0-4625-g5b080e60b3a (5b080e60b3a864892f15f47b8840772b1475ecfc) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fb5b0f299d8] , 2: (()+0x276bf2) [0x7fb5b0f29bf2] Ignoring malparsed backtrace: 2020-08-23T10:52:30.515 INFO:teuthology.orchestra.run.smithi200:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T10:52:30.645 INFO:teuthology.orchestra.run.smithi200.stdout:{ , 2020-08-23T10:52:30.646 INFO:teuthology.orchestra.run.smithi200.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2020-08-23T10:52:33.867 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2020-08-23T10:51:43.873475+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=43, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:52:33.867 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-08-23T10:51:48.868152+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=48, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:52:33.867 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2020-08-23T10:52:02.933519+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=2, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:52:33.882 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2020-08-23T10:51:36.095965+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=36, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:52:33.882 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2020-08-23T10:51:32.072394+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:52:33.883 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2020-08-23T10:51:40.122240+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=40, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:52:54.966 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2020-08-23T10:51:40.122240+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=40, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:52:54.966 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2020-08-23T10:51:43.873475+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=43, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:52:54.966 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2020-08-23T10:51:48.868152+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=48, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:52:54.981 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2020-08-23T10:51:53.895293+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=53, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:52:54.981 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2020-08-23T10:51:36.095965+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=36, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:52:54.981 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2020-08-23T10:51:40.122240+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=40, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:53:15.346 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2020-08-23T10:51:53.895293+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=53, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:53:15.346 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2020-08-23T10:51:43.873475+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=43, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:53:15.346 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2020-08-23T10:51:48.868152+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=48, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:53:35.710 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2020-08-23T10:51:48.868152+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=48, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:53:35.710 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2020-08-23T10:51:53.895293+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=53, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:53:35.710 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2020-08-23T10:51:48.868152+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=48, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:53:56.073 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2020-08-23T10:51:48.868152+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=51, tm_sec=48, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:53:56.073 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2020-08-23T10:52:02.933519+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=2, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:53:56.073 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2020-08-23T10:52:02.933519+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=2, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=52, tm_sec=29, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:54:39.051 DEBUG:teuthology.orchestra.remote:smithi200:/tmp/tmp.Knh4NQCLMJ is 1MB , 2020-08-23T10:54:39.165 INFO:teuthology.orchestra.run.smithi200:> rm -fr /tmp/tmp.Knh4NQCLMJ , 2020-08-23T10:54:39.179 DEBUG:teuthology.misc:Transferring archived files from smithi200:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/trociny-2020-08-23_07:21:43-rbd-wip-mgolub-testing-distro-basic-smithi/5369028/data/mon.c.tgz Ignoring malparsed backtrace: 2020-08-23T10:54:48.568 INFO:teuthology.orchestra.run.smithi142.stdout:Remove 1 Package , 2020-08-23T10:54:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: , 2020-08-23T10:54:48.569 INFO:teuthology.orchestra.run.smithi142.stdout:Freed space: 41 M Ignoring malparsed backtrace: 2020-08-23T10:54:50.328 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size , 2020-08-23T10:54:50.329 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ , 2020-08-23T10:54:50.329 INFO:teuthology.orchestra.run.smithi053.stdout:Removing: Ignoring malparsed backtrace: 2020-08-23T10:54:52.624 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/1 , 2020-08-23T10:54:52.654 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T10:54:52.655 INFO:teuthology.orchestra.run.smithi200.stdout:================================================================================ Ignoring malparsed backtrace: 2020-08-23T10:54:54.081 INFO:teuthology.orchestra.run.smithi200.stdout: ceph-osd-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T10:54:54.082 INFO:teuthology.orchestra.run.smithi200.stdout: , 2020-08-23T10:54:54.082 INFO:teuthology.orchestra.run.smithi200.stdout:Complete! Ignoring malparsed backtrace: 2020-08-23T10:54:54.659 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest noarch2.0.33-1.el8 @epel 289 k , 2020-08-23T10:54:54.659 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch0.12.2-4.el8 @CentOS-AppStream 2.0 M , 2020-08-23T10:54:54.659 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch2.0-2.el8 @epel 35 k Ignoring malparsed backtrace: 2020-08-23T10:54:54.884 INFO:teuthology.orchestra.run.smithi200.stdout: python3-webob noarch1.8.5-1.el8.1 @epel 1.2 M , 2020-08-23T10:54:54.884 INFO:teuthology.orchestra.run.smithi200.stdout: python3-websocket-client noarch0.56.0-5.el8 @epel 180 k , 2020-08-23T10:54:54.884 INFO:teuthology.orchestra.run.smithi200.stdout: python3-webtest noarch2.0.33-1.el8 @epel 289 k Ignoring malparsed backtrace: 2020-08-23T10:54:55.087 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress noarch1.2.1-2.el8.1 @epel 1.0 M , 2020-08-23T10:54:55.087 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webencodings noarch0.5.1-6.el8 @CentOS-AppStream 72 k , 2020-08-23T10:54:55.088 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch1.8.5-1.el8.1 @epel 1.2 M Ignoring malparsed backtrace: 2020-08-23T10:54:59.880 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f 19/85 , 2020-08-23T10:54:59.903 INFO:teuthology.orchestra.run.smithi200.stdout: Running scriptlet: rbd-mirror-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 20/85 , 2020-08-23T10:54:59.903 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : rbd-mirror-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 20/85 Ignoring malparsed backtrace: 2020-08-23T10:55:05.018 INFO:teuthology.orchestra.run.smithi142.stdout: Erasing : python3-logutils-0.3.5-11.el8.noarch 53/85 , 2020-08-23T10:55:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: Erasing : ceph-grafana-dashboards-2:16.0.0-4625.g5b080e60b3a 50/85 , 2020-08-23T10:55:05.115 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : ceph-prometheus-alerts-2:16.0.0-4625.g5b080e60b3a. 51/85 Ignoring malparsed backtrace: 2020-08-23T10:55:23.453 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : python3-cssselect-0.9.2-10.el8.noarch 69/85 , 2020-08-23T10:55:23.453 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : openblas-0.3.3-2.el8.x86_64 70/85 , 2020-08-23T10:55:23.534 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 70/85 Ignoring malparsed backtrace: 2020-08-23T10:55:26.311 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : libxslt-1.1.32-3.el8.x86_64 83/85 , 2020-08-23T10:55:26.311 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 26/85 , 2020-08-23T10:55:26.311 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 27/85 Ignoring malparsed backtrace: 2020-08-23T10:55:26.912 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 36/85 , 2020-08-23T10:55:26.912 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 37/85 , 2020-08-23T10:55:26.912 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 38/85 Ignoring malparsed backtrace: 2020-08-23T10:55:26.968 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/85 , 2020-08-23T10:55:26.968 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 53/85 , 2020-08-23T10:55:26.968 INFO:teuthology.orchestra.run.smithi200.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 54/85 Ignoring malparsed backtrace: 2020-08-23T10:55:28.009 INFO:teuthology.orchestra.run.smithi142.stdout: python3-remoto-1.1.4-4.el8.noarch , 2020-08-23T10:55:28.009 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-6.el8.noarch , 2020-08-23T10:55:28.009 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.20.0-2.1.el8_1.noarch Ignoring malparsed backtrace: 2020-08-23T10:55:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: python3-trustme-0.5.2-4.el8.noarch , 2020-08-23T10:55:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.24.2-2.el8.noarch , 2020-08-23T10:55:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress-1.2.1-2.el8.1.noarch Ignoring malparsed backtrace: 2020-08-23T10:55:28.720 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. , 2020-08-23T10:55:28.720 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ , 2020-08-23T10:55:28.721 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size Ignoring malparsed backtrace: 2020-08-23T10:55:31.052 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test , 2020-08-23T10:55:31.077 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. , 2020-08-23T10:55:31.077 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction Ignoring malparsed backtrace: 2020-08-23T10:55:33.857 INFO:teuthology.orchestra.run.smithi200.stdout:Complete! , 2020-08-23T10:55:34.010 INFO:teuthology.orchestra.run.smithi142.stdout:No match for argument: ceph-mgr-rook , No packages marked for removal. Ignoring malparsed backtrace: 2020-08-23T10:55:35.822 INFO:teuthology.orchestra.run.smithi200.stdout: , 2020-08-23T10:55:35.822 INFO:teuthology.orchestra.run.smithi200.stdout:Transaction Summary , 2020-08-23T10:55:35.822 INFO:teuthology.orchestra.run.smithi200.stdout:================================================================================ Ignoring malparsed backtrace: 2020-08-23T10:55:37.759 INFO:teuthology.orchestra.run.smithi200.stdout:Dependencies resolved. , 2020-08-23T10:55:37.761 INFO:teuthology.orchestra.run.smithi200.stdout:================================================================================ , 2020-08-23T10:55:37.761 INFO:teuthology.orchestra.run.smithi200.stdout: Package Arch Version Repo Size Ignoring malparsed backtrace: 2020-08-23T10:55:39.891 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary , 2020-08-23T10:55:39.891 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ , 2020-08-23T10:55:39.891 INFO:teuthology.orchestra.run.smithi142.stdout:Remove 7 Packages Ignoring malparsed backtrace: 2020-08-23T10:55:41.856 INFO:teuthology.orchestra.run.smithi200.stdout: Erasing : librados2-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 5/7 , 2020-08-23T10:55:41.856 INFO:teuthology.orchestra.run.smithi200.stdout:warning: file /etc/ceph: remove failed: No such file or directory , 2020-08-23T10:55:41.856 INFO:teuthology.orchestra.run.smithi200.stdout: Ignoring malparsed backtrace: 2020-08-23T10:55:44.445 INFO:teuthology.orchestra.run.smithi142.stdout:No match for argument: python3-cephfs , No packages marked for removal. , 2020-08-23T10:55:44.449 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. Ignoring malparsed backtrace: 2020-08-23T10:55:47.449 INFO:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/yum.repos.d/ceph.repo , 2020-08-23T10:55:47.520 INFO:teuthology.orchestra.run.smithi053:> sudo yum clean expire-cache , 2020-08-23T10:55:47.610 INFO:teuthology.orchestra.run.smithi200.stdout:51 files removed Ignoring malparsed backtrace: 2020-08-23T10:55:49.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump , 2020-08-23T10:55:49.379 INFO:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump , 2020-08-23T10:55:49.382 INFO:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump Ignoring malparsed backtrace: ceph version 16.0.0-4625-g5b080e60b3a (5b080e60b3a864892f15f47b8840772b1475ecfc) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f3619c289d8] , 2: (()+0x276bf2) [0x7f3619c28bf2] Ignoring malparsed backtrace: 2020-08-23T10:36:14.568 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T10:36:14.701 INFO:teuthology.orchestra.run.smithi074.stdout:{ , 2020-08-23T10:36:14.701 INFO:teuthology.orchestra.run.smithi074.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2020-08-23T10:36:17.934 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2020-08-23T10:35:49.143603+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:17.934 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2020-08-23T10:35:42.093035+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=42, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:17.934 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2020-08-23T10:35:32.035382+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=32, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:36:17.948 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2020-08-23T10:35:34.049302+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=34, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:17.949 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-08-23T10:35:36.060145+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=36, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:17.949 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-08-23T10:35:39.083134+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=39, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:36:38.315 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2020-08-23T10:35:34.049302+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=34, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:38.316 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2020-08-23T10:35:36.060145+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=36, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:38.316 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2020-08-23T10:35:39.083134+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=39, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:36:38.329 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2020-08-23T10:35:34.049302+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=34, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:38.329 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2020-08-23T10:35:36.060145+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=36, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:38.330 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2020-08-23T10:35:39.083134+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=39, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:36:58.694 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2020-08-23T10:35:34.049302+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=34, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:58.695 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2020-08-23T10:35:36.060145+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=36, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:58.695 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2020-08-23T10:35:39.083134+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=39, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:36:58.709 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2020-08-23T10:35:36.060145+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=36, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:58.710 INFO:tasks.ceph:pgid 10.1f last_scrub_stamp 2020-08-23T10:35:49.143603+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:36:58.710 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2020-08-23T10:35:42.093035+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=42, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:37:19.093 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2020-08-23T10:35:49.143603+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:37:19.094 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2020-08-23T10:35:42.093035+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=42, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:37:19.094 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2020-08-23T10:35:36.060145+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=36, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:37:59.778 INFO:tasks.ceph:pgid 10.19 last_scrub_stamp 2020-08-23T10:35:49.143603+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=49, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:37:59.779 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T10:35:42.093035+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=42, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:37:59.779 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2020-08-23T10:35:42.093035+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=35, tm_sec=42, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=36, tm_sec=13, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:41:03.748 DEBUG:tasks.ceph.osd.6:waiting for process to exit , 2020-08-23T10:41:03.748 INFO:teuthology.orchestra.run:waiting for 300 , 2020-08-23T10:41:03.818 INFO:tasks.ceph.osd.6:Stopped Ignoring malparsed backtrace: 2020-08-23T10:41:15.659 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. , 2020-08-23T10:41:15.660 INFO:teuthology.orchestra.run.smithi074:> , 2020-08-23T10:41:15.660 INFO:teuthology.orchestra.run.smithi074:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do Ignoring malparsed backtrace: 2020-08-23T10:41:17.484 INFO:teuthology.orchestra.run.smithi099.stdout:Installed products updated. , 2020-08-23T10:41:17.574 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-radosgw-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/1 , 2020-08-23T10:41:17.574 INFO:teuthology.orchestra.run.smithi093.stdout:Installed products updated. Ignoring malparsed backtrace: 2020-08-23T10:41:20.802 INFO:teuthology.orchestra.run.smithi074.stdout: Erasing : ceph-test-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/5 , 2020-08-23T10:41:20.846 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 , 2020-08-23T10:41:20.906 INFO:teuthology.orchestra.run.smithi099.stdout: Erasing : ceph-test-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 1/5 Ignoring malparsed backtrace: 2020-08-23T10:41:25.132 INFO:teuthology.orchestra.run.smithi099.stdout:Removing unused dependencies: , 2020-08-23T10:41:25.132 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:16.0.0-4625.g5b080e60b3a.el8 @ceph 7.5 M , 2020-08-23T10:41:25.132 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:16.0.0-4625.g5b080e60b3a.el8 @ceph 16 M Ignoring malparsed backtrace: 2020-08-23T10:41:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T10:41:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 , 2020-08-23T10:41:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: Ignoring malparsed backtrace: 2020-08-23T10:41:29.807 INFO:teuthology.orchestra.run.smithi074.stdout: python3-simplegeneric noarch 0.8.1-17.el8 @epel 24 k , 2020-08-23T10:41:29.807 INFO:teuthology.orchestra.run.smithi074.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 @epel 43 k , 2020-08-23T10:41:29.807 INFO:teuthology.orchestra.run.smithi074.stdout: python3-tempora noarch 1.14.1-5.el8 @epel 82 k Ignoring malparsed backtrace: 2020-08-23T10:41:29.819 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 0.12.2-4.el8 @rhel-8-for-x86_64-appstream-rpms 2.0 M , 2020-08-23T10:41:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-2.el8 @epel 35 k , 2020-08-23T10:41:29.820 INFO:teuthology.orchestra.run.smithi099.stdout: Ignoring malparsed backtrace: 2020-08-23T10:41:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 @epel 43 k , 2020-08-23T10:41:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora noarch 1.14.1-5.el8 @epel 82 k , 2020-08-23T10:41:30.040 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme noarch 0.5.2-4.el8 @epel 51 k Ignoring malparsed backtrace: 2020-08-23T10:41:34.700 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 18/81 , 2020-08-23T10:41:34.701 INFO:teuthology.orchestra.run.smithi099.stdout: Erasing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 19/81 , 2020-08-23T10:41:34.715 INFO:teuthology.orchestra.run.smithi093.stdout: Erasing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 17/81 Ignoring malparsed backtrace: 2020-08-23T10:41:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 50/81 , 2020-08-23T10:41:40.431 INFO:teuthology.orchestra.run.smithi093.stdout: Erasing : python3-logutils-0.3.5-11.el8.noarch 49/81 , 2020-08-23T10:41:40.492 INFO:teuthology.orchestra.run.smithi074.stdout: Erasing : python3-lxml-4.2.3-1.el8.x86_64 52/81 Ignoring malparsed backtrace: 2020-08-23T10:41:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev , 2020-08-23T10:41:57.727 INFO:teuthology.orchestra.run.smithi093.stdout: , 2020-08-23T10:41:57.850 INFO:teuthology.orchestra.run.smithi074.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 66/81 Ignoring malparsed backtrace: 2020-08-23T10:42:00.518 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python3-cephfs-2:16.0.0-4625.g5b080e60b3a.el8.x86_ 32/81 , 2020-08-23T10:42:00.518 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 33/81 , 2020-08-23T10:42:00.519 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 34/81 Ignoring malparsed backtrace: 2020-08-23T10:42:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/81 , 2020-08-23T10:42:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 50/81 , 2020-08-23T10:42:00.902 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 51/81 Ignoring malparsed backtrace: 2020-08-23T10:42:00.963 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 69/81 , 2020-08-23T10:42:00.963 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 70/81 , 2020-08-23T10:42:00.963 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 71/81 Ignoring malparsed backtrace: 2020-08-23T10:42:04.417 INFO:teuthology.orchestra.run.smithi074.stdout: , 2020-08-23T10:42:04.418 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! , 2020-08-23T10:42:04.488 INFO:teuthology.orchestra.run.smithi099.stdout: Ignoring malparsed backtrace: 2020-08-23T10:42:04.508 INFO:teuthology.orchestra.run.smithi093.stdout: leveldb-1.22-1.el8.x86_64 , 2020-08-23T10:42:04.508 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran-8.3.1-5.el8.x86_64 , 2020-08-23T10:42:04.508 INFO:teuthology.orchestra.run.smithi093.stdout: liboath-2.6.2-3.el8.x86_64 Ignoring malparsed backtrace: 2020-08-23T10:42:05.539 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size , 2020-08-23T10:42:05.540 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ , 2020-08-23T10:42:05.540 INFO:teuthology.orchestra.run.smithi093.stdout:Removing: Ignoring malparsed backtrace: 2020-08-23T10:42:10.158 INFO:teuthology.orchestra.run.smithi093.stdout: Erasing : ceph-immutable-object-cache-2:16.0.0-4625.g5b080e60b 1/1 , Modular dependency problem: , Ignoring malparsed backtrace: 2020-08-23T10:42:14.225 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. , 2020-08-23T10:42:14.226 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. , 2020-08-23T10:42:14.226 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! Ignoring malparsed backtrace: 2020-08-23T10:42:17.371 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. , 2020-08-23T10:42:17.371 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! , 2020-08-23T10:42:17.634 INFO:teuthology.orchestra.run.smithi099.stdout:Updating Subscription Management repositories. Ignoring malparsed backtrace: 2020-08-23T10:42:19.061 INFO:teuthology.orchestra.run.smithi099.stdout:Freed space: 2.2 M , 2020-08-23T10:42:19.061 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check , 2020-08-23T10:42:19.063 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. Ignoring malparsed backtrace: 2020-08-23T10:42:22.831 INFO:teuthology.orchestra.run.smithi074.stdout: , 2020-08-23T10:42:22.831 INFO:teuthology.orchestra.run.smithi074.stdout:Freed space: 2.2 M , 2020-08-23T10:42:22.831 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check Ignoring malparsed backtrace: 2020-08-23T10:42:26.910 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. , Modular dependency problem: , Ignoring malparsed backtrace: 2020-08-23T10:42:28.603 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction , 2020-08-23T10:42:28.708 INFO:teuthology.orchestra.run.smithi093.stdout: Erasing : rbd-fuse-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 2/7 , 2020-08-23T10:42:28.719 INFO:teuthology.orchestra.run.smithi074.stdout: Preparing : 1/1 Ignoring malparsed backtrace: 2020-08-23T10:42:32.156 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! , 2020-08-23T10:42:32.344 INFO:teuthology.orchestra.run.smithi074.stdout: , 2020-08-23T10:42:32.344 INFO:teuthology.orchestra.run.smithi074.stdout:Removed: Ignoring malparsed backtrace: 2020-08-23T10:42:35.158 INFO:teuthology.orchestra.run.smithi074.stdout:Nothing to do. , 2020-08-23T10:42:35.158 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! , 2020-08-23T10:42:35.429 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. Ignoring malparsed backtrace: 2020-08-23T10:42:38.639 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. , 2020-08-23T10:42:38.640 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. , 2020-08-23T10:42:38.641 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! Ignoring malparsed backtrace: 2020-08-23T10:42:42.780 INFO:teuthology.orchestra.run.smithi099.stdout:RedHatEnterprise , 2020-08-23T10:42:42.781 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise , 2020-08-23T10:42:42.782 INFO:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/yum.repos.d/ceph.repo Ignoring malparsed backtrace: 2020-08-23T10:42:45.046 INFO:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . , 2020-08-23T10:42:45.100 DEBUG:teuthology.misc:Transferring archived files from smithi093:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/trociny-2020-08-23_07:21:43-rbd-wip-mgolub-testing-distro-basic-smithi/5369013/remote/smithi093 , 2020-08-23T10:42:45.100 INFO:teuthology.orchestra.run.smithi093:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . Ignoring malparsed backtrace: ceph version 16.0.0-4625-g5b080e60b3a (5b080e60b3a864892f15f47b8840772b1475ecfc) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f4e531949d8] , 2: (()+0x276bf2) [0x7f4e53194bf2] Ignoring malparsed backtrace: 2020-08-23T10:49:02.698 INFO:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 , 2020-08-23T10:49:02.839 INFO:teuthology.orchestra.run.smithi008.stdout:{ , 2020-08-23T10:49:02.840 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " Ignoring malparsed backtrace: 2020-08-23T10:49:06.497 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2020-08-23T10:48:03.791547+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=3, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:06.497 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2020-08-23T10:48:14.044275+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:06.498 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2020-08-23T10:48:07.011724+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=7, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:49:06.512 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2020-08-23T10:47:58.992723+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=47, tm_sec=58, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:06.512 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-08-23T10:48:00.996329+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:06.513 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-08-23T10:48:03.791547+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=3, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:49:26.876 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2020-08-23T10:47:52.951696+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=47, tm_sec=52, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:26.877 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2020-08-23T10:47:58.992723+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=47, tm_sec=58, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:26.877 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2020-08-23T10:48:00.996329+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:49:26.891 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2020-08-23T10:48:07.011724+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=7, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:26.891 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2020-08-23T10:47:58.992723+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=47, tm_sec=58, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:26.891 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2020-08-23T10:48:00.996329+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:49:47.251 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2020-08-23T10:47:58.992723+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=47, tm_sec=58, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:47.252 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2020-08-23T10:48:00.996329+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=0, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:47.252 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2020-08-23T10:48:03.791547+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=3, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:49:47.266 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2020-08-23T10:48:07.011724+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=7, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:47.266 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2020-08-23T10:48:03.791547+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=3, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:49:47.266 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2020-08-23T10:47:58.992723+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=47, tm_sec=58, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:50:28.033 INFO:tasks.ceph:pgid 10.17 last_scrub_stamp 2020-08-23T10:48:14.044275+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:50:28.033 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2020-08-23T10:48:03.791547+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=3, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) , 2020-08-23T10:50:28.033 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2020-08-23T10:48:07.011724+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=48, tm_sec=7, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=10, tm_min=49, tm_sec=1, tm_wday=6, tm_yday=236, tm_isdst=0) Ignoring malparsed backtrace: 2020-08-23T10:51:30.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi008.front.sepia.ceph.com , 2020-08-23T10:51:30.082 INFO:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2020-08-23T10:51:30.415 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi008.front.sepia.ceph.com Ignoring malparsed backtrace: Problem: conflicting requests , - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T10:51:42.237 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. Ignoring malparsed backtrace: 2020-08-23T10:51:46.350 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. , 2020-08-23T10:51:46.351 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================= , 2020-08-23T10:51:46.352 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size Ignoring malparsed backtrace: 2020-08-23T10:51:47.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/5 , 2020-08-23T10:51:47.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/5 , 2020-08-23T10:51:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: Erasing : socat-1.7.3.3-2.el8.x86_64 4/5 Ignoring malparsed backtrace: 2020-08-23T10:51:51.712 INFO:teuthology.orchestra.run.smithi033.stdout:Removing: , 2020-08-23T10:51:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:16.0.0-4625.g5b080e60b3a.el8 @ceph 0 , 2020-08-23T10:51:51.713 INFO:teuthology.orchestra.run.smithi033.stdout:Removing unused dependencies: Ignoring malparsed backtrace: 2020-08-23T10:51:56.229 INFO:teuthology.orchestra.run.smithi038.stdout:Removing dependent packages: , 2020-08-23T10:51:56.229 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:16.0.0-4625.g5b080e60b3a.el8 @ceph-noarch 117 k , 2020-08-23T10:51:56.229 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:16.0.0-4625.g5b080e60b3a.el8 @ceph 14 M Ignoring malparsed backtrace: 2020-08-23T10:51:56.441 INFO:teuthology.orchestra.run.smithi008.stdout:Removing: , 2020-08-23T10:51:56.442 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:16.0.0-4625.g5b080e60b3a.el8 @ceph 28 M , 2020-08-23T10:51:56.442 INFO:teuthology.orchestra.run.smithi008.stdout:Removing dependent packages: Ignoring malparsed backtrace: 2020-08-23T10:51:56.513 INFO:teuthology.orchestra.run.smithi033.stdout:Removing: , 2020-08-23T10:51:56.513 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:16.0.0-4625.g5b080e60b3a.el8 @ceph 28 M , 2020-08-23T10:51:56.514 INFO:teuthology.orchestra.run.smithi033.stdout:Removing dependent packages: Ignoring malparsed backtrace: 2020-08-23T10:51:57.504 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5b080e60b3a.el8.noarch 1/1 , 2020-08-23T10:51:57.505 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-mgr-rook-2:16.0.0-4625.g5b080e60b3a.el8.noarc 1/81 , 2020-08-23T10:51:57.597 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5b080e60b3a.el8.noarc 1/81 Ignoring malparsed backtrace: 2020-08-23T10:52:03.315 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 25/81 , 2020-08-23T10:52:03.420 INFO:teuthology.orchestra.run.smithi033.stdout: Erasing : python3-pyasn1-modules-0.3.7-6.el8.noarch 23/81 , 2020-08-23T10:52:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-portend-2.6-1.el8.noarch 26/81 Ignoring malparsed backtrace: 2020-08-23T10:52:08.954 INFO:teuthology.orchestra.run.smithi038.stdout: Erasing : python3-rgw-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 55/81 , 2020-08-23T10:52:08.955 INFO:teuthology.orchestra.run.smithi038.stdout: Erasing : librgw2-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 56/81 , 2020-08-23T10:52:09.027 INFO:teuthology.orchestra.run.smithi033.stdout: Erasing : python3-lxml-4.2.3-1.el8.x86_64 52/81 Ignoring malparsed backtrace: 2020-08-23T10:52:27.607 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 66/81 , 2020-08-23T10:52:27.607 INFO:teuthology.orchestra.run.smithi033.stdout: Erasing : openblas-threads-0.3.3-5.el8.x86_64 67/81 , 2020-08-23T10:52:27.700 INFO:teuthology.orchestra.run.smithi038.stdout: Erasing : libunwind-1.3.1-3.el8.x86_64 72/81 Ignoring malparsed backtrace: 2020-08-23T10:52:29.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:16.0.0-4625.g5b080e60b3a.el8.x86_6 61/81 , 2020-08-23T10:52:29.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 62/81 , 2020-08-23T10:52:29.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 63/81 Ignoring malparsed backtrace: 2020-08-23T10:52:29.581 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 80/81 , 2020-08-23T10:52:29.631 INFO:teuthology.orchestra.run.smithi033.stdout: Erasing : leveldb-1.22-1.el8.x86_64 77/81 , 2020-08-23T10:52:29.632 INFO:teuthology.orchestra.run.smithi033.stdout: Erasing : libradosstriper1-2:16.0.0-4625.g5b080e60b3a.el8.x8 78/81 Ignoring malparsed backtrace: 2020-08-23T10:52:32.880 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:16.0.0-4625.g5b080e60b3a.el8.noarch , 2020-08-23T10:52:32.880 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:16.0.0-4625.g5b080e60b3a.el8.noarch , 2020-08-23T10:52:32.880 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:16.0.0-4625.g5b080e60b3a.el8.noarch Ignoring malparsed backtrace: 2020-08-23T10:52:33.225 INFO:teuthology.orchestra.run.smithi008.stdout: libxslt-1.1.32-4.el8.x86_64 , 2020-08-23T10:52:33.225 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.3-5.el8.x86_64 , 2020-08-23T10:52:33.225 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.3-5.el8.x86_64 Ignoring malparsed backtrace: 2020-08-23T10:52:34.528 INFO:teuthology.orchestra.run.smithi033.stdout: leveldb-1.22-1.el8.x86_64 , 2020-08-23T10:52:34.528 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-8.3.1-5.el8.x86_64 , 2020-08-23T10:52:34.528 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.2-3.el8.x86_64 Ignoring malparsed backtrace: Problem: conflicting requests , - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T10:52:35.654 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. Ignoring malparsed backtrace: 2020-08-23T10:52:39.907 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-4625.g5b080e60b 1/1 , 2020-08-23T10:52:39.908 INFO:teuthology.orchestra.run.smithi038.stdout:Installed products updated. , 2020-08-23T10:52:40.109 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. Ignoring malparsed backtrace: Problem: conflicting requests , - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T10:52:45.212 INFO:teuthology.orchestra.run.smithi038.stdout:No match for argument: ceph-mgr-diskprediction-local Ignoring malparsed backtrace: 2020-08-23T10:52:48.153 INFO:teuthology.orchestra.run.smithi038.stdout: , 2020-08-23T10:52:48.153 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary , 2020-08-23T10:52:48.153 INFO:teuthology.orchestra.run.smithi038.stdout:=========================================================================================== Ignoring malparsed backtrace: 2020-08-23T10:52:50.633 INFO:teuthology.orchestra.run.smithi033.stdout: Erasing : fuse-2.9.7-12.el8.x86_64 2/3 , 2020-08-23T10:52:50.633 INFO:teuthology.orchestra.run.smithi033.stdout: Erasing : fuse-common-3.2.1-12.el8.x86_64 3/3 , 2020-08-23T10:52:50.633 INFO:teuthology.orchestra.run.smithi033.stdout:warning: /etc/fuse.conf saved as /etc/fuse.conf.rpmsave Ignoring malparsed backtrace: , Problem: conflicting requests , - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 Ignoring malparsed backtrace: 2020-08-23T10:52:58.937 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. , 2020-08-23T10:52:58.939 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================================================== , 2020-08-23T10:52:58.939 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size Ignoring malparsed backtrace: 2020-08-23T10:53:00.657 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 2/7 , 2020-08-23T10:53:00.657 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.0.0-4625.g5b080e60b3a.el8.x86_64 3/7 , 2020-08-23T10:53:00.657 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 4/7 Ignoring malparsed backtrace: Problem: conflicting requests , - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T10:53:04.478 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: librbd1 Ignoring malparsed backtrace: Modular dependency problem: , , Problem: conflicting requests Ignoring malparsed backtrace: Problem: conflicting requests , - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 , 2020-08-23T10:53:11.438 INFO:teuthology.orchestra.run.smithi033.stdout:No match for argument: rbd-fuse Ignoring malparsed backtrace: 2020-08-23T10:53:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 15 +2097us[+2123us] +/- 49ms , 2020-08-23T10:53:15.556 INFO:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true , bash: ntpq: command not found Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 182, in _raise_for_status , node=self.hostname, label=self.label , teuthology.exceptions.CommandFailedError: Command failed on smithi033 with status 1: 'which \'ceph_test_librbd\'"\'"\',\'' Found 1 distinct failure reasons Failure: Command failed (workunit test rbd/test_librbd.sh) on smithi005 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5b080e60b3a864892f15f47b8840772b1475ecfc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 RBD_FEATURES=125 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' 5 jobs: ['5369093', '5369033', '5369028', '5369013', '5369022'] suites intersection: ['openstack}'] suites union: ['centos_latest', 'clusters/{fixed-1', 'clusters/{fixed-3', 'config/copy-on-read', 'config/none', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'pool/none', 'pool/replicated-data-pool', 'pool/small-cache-pool', 'rbd/librbd/{cache/writeback', 'rbd/valgrind/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'validator/memcheck', 'workloads/c_api_tests_with_defaults}', 'workloads/c_api_tests_with_journaling}']