Found 200 jobs
Ignoring malparsed backtrace:  ceph version 16.0.0-4625-g5661c49e31d (5661c49e31df2517dd62fef514a6210e37e9b4ac) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f655a3289d8]
,  2: (()+0x276bf2) [0x7f655a328bf2]

Ignoring malparsed backtrace: 2020-08-23T19:13:16.745 INFO:teuthology.orchestra.run.smithi059.stdout:}
, 2020-08-23T19:13:16.754 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub

Ignoring malparsed backtrace: 2020-08-23T19:13:40.444 INFO:tasks.ceph:pgid 55.15 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T19:13:40.445 INFO:tasks.ceph:pgid 55.12 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T19:13:40.445 INFO:tasks.ceph:pgid 55.10 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)

Ignoring malparsed backtrace: 2020-08-23T19:14:04.540 INFO:teuthology.orchestra.run.smithi059:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T19:14:04.555 INFO:teuthology.orchestra.run.smithi155:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T19:14:04.582 INFO:teuthology.orchestra.run.smithi037:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq

Ignoring malparsed backtrace: 2020-08-23T19:14:35.942 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded.
, 2020-08-23T19:14:35.943 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test
, 2020-08-23T19:14:35.945 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-radosgw-2:16.0.0-4625.g5661c49e31d.el8.x86_64     1/1

Ignoring malparsed backtrace: 2020-08-23T19:14:37.894 INFO:teuthology.orchestra.run.smithi155.stdout:  Preparing        :                                                        1/1
, 2020-08-23T19:14:37.906 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : ceph-test-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/5
, 2020-08-23T19:14:38.064 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : jq-1.5-12.el8.x86_64                                   2/5

Ignoring malparsed backtrace: 2020-08-23T19:14:40.117 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction
, 2020-08-23T19:14:40.135 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved.
, 2020-08-23T19:14:40.136 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T19:14:42.084 INFO:teuthology.orchestra.run.smithi059.stdout:Removing unused dependencies:
, 2020-08-23T19:14:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T19:14:42.085 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T19:14:42.469 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook                   noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      117 k
, 2020-08-23T19:14:42.470 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror                      x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             14 M
, 2020-08-23T19:14:42.470 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies:

Ignoring malparsed backtrace: 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout:Removing unused dependencies:
, 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T19:14:43.323 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5661c49e31d.el8.noarc    1/85
, 2020-08-23T19:14:43.342 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-mgr-2:16.0.0-4625.g5661c49e31d.el8.x86_64        2/85
, 2020-08-23T19:14:43.343 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : ceph-mgr-2:16.0.0-4625.g5661c49e31d.el8.x86_64        2/85

Ignoring malparsed backtrace: 2020-08-23T19:14:48.073 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : python3-urllib3-1.24.2-2.el8.noarch                  24/85
, 2020-08-23T19:14:48.156 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : python3-portend-2.6-1.el8.noarch                     27/85
, 2020-08-23T19:14:48.198 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : python3-babel-2.5.1-5.el8.noarch                     23/85

Ignoring malparsed backtrace: 2020-08-23T19:14:52.677 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : python3-websocket-client-0.56.0-5.el8.noarch         49/85
, 2020-08-23T19:14:52.747 INFO:teuthology.orchestra.run.smithi037.stdout:  Running scriptlet: ceph-base-2:16.0.0-4625.g5661c49e31d.el8.x86_64      57/85
, 2020-08-23T19:14:52.747 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : ceph-common-2:16.0.0-4625.g5661c49e31d.el8.x86_64    58/85

Ignoring malparsed backtrace: 2020-08-23T19:15:11.014 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : openblas-threads-0.3.3-2.el8.x86_64                  71/85
, 2020-08-23T19:15:11.062 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : python3-rados-2:16.0.0-4625.g5661c49e31d.el8.x86_6   75/85
, 2020-08-23T19:15:11.211 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : libunwind-1.3.1-3.el8.x86_64                         76/85

Ignoring malparsed backtrace: 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-mako-1.0.6-13.el8.noarch                     50/85
, 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-markupsafe-0.23-19.el8.x86_64                51/85
, 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-more-itertools-7.2.0-3.el8.noarch            52/85

Ignoring malparsed backtrace: 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pyasn1-modules-0.3.7-6.el8.noarch            60/85
, 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pysocks-1.6.8-3.el8.noarch                   61/85
, 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pytz-2017.2-9.el8.noarch                     62/85

Ignoring malparsed backtrace: 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-simplegeneric-0.8.1-17.el8.noarch            73/85
, 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-singledispatch-3.4.0.3-18.el8.noarch         74/85
, 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-tempora-1.14.1-5.el8.noarch                  75/85

Ignoring malparsed backtrace: 2020-08-23T19:15:14.561 INFO:teuthology.orchestra.run.smithi037.stdout:Complete!
, 2020-08-23T19:15:15.291 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:15.292 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-waitress-1.2.1-2.el8.1.noarch
, 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-webencodings-0.5.1-6.el8.noarch
, 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-webob-1.8.5-1.el8.1.noarch

Ignoring malparsed backtrace: 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout: Package      Arch        Version                              Repository  Size
, 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================
, 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout:Removing:

Ignoring malparsed backtrace: 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================
, 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:Remove  1 Package
, 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:

Ignoring malparsed backtrace: 2020-08-23T19:15:21.535 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:21.536 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================
, 2020-08-23T19:15:21.536 INFO:teuthology.orchestra.run.smithi037.stdout: Package       Arch     Version                            Repository      Size

Ignoring malparsed backtrace: 2020-08-23T19:15:23.147 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check
, 2020-08-23T19:15:23.148 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded.
, 2020-08-23T19:15:23.148 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test

Ignoring malparsed backtrace: 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel     x86_64    2:16.0.0-4625.g5661c49e31d.el8     @ceph    436 k
, 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout:Removing dependent packages:
, 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel    x86_64    2:16.0.0-4625.g5661c49e31d.el8     @ceph     84 k

Ignoring malparsed backtrace: 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : librados2-2:16.0.0-4625.g5661c49e31d.el8.x86_64        5/7
, 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:warning: file /etc/ceph: remove failed: No such file or directory
, 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:

Ignoring malparsed backtrace: 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:  Running scriptlet: librbd1-2:16.0.0-4625.g5661c49e31d.el8.x86_64          4/7
, 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : librados2-2:16.0.0-4625.g5661c49e31d.el8.x86_64        5/7
, 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:warning: file /etc/ceph: remove failed: No such file or directory

Ignoring malparsed backtrace: No packages marked for removal.
, 2020-08-23T19:15:31.530 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:31.532 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do.

Ignoring malparsed backtrace: 2020-08-23T19:15:35.172 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS
, 2020-08-23T19:15:35.172 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS
, 2020-08-23T19:15:35.173 DEBUG:teuthology.misc:System to be installed: CentOS

Ignoring malparsed backtrace: 2020-08-23T19:16:04.886 INFO:teuthology.task.internal:Transferring binaries for coredumps...
, 2020-08-23T19:16:04.924 INFO:teuthology.orchestra.run.smithi037:> which ceph_test_librbd
, which: no ceph_test_librbd in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin)

Ignoring malparsed backtrace:  ceph version 16.0.0-4625-g5661c49e31d (5661c49e31df2517dd62fef514a6210e37e9b4ac) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f655a3289d8]
,  2: (()+0x276bf2) [0x7f655a328bf2]

Ignoring malparsed backtrace: 2020-08-23T19:13:16.745 INFO:teuthology.orchestra.run.smithi059.stdout:}
, 2020-08-23T19:13:16.754 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub

Ignoring malparsed backtrace: 2020-08-23T19:13:40.444 INFO:tasks.ceph:pgid 55.15 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T19:13:40.445 INFO:tasks.ceph:pgid 55.12 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T19:13:40.445 INFO:tasks.ceph:pgid 55.10 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)

Ignoring malparsed backtrace: 2020-08-23T19:14:04.540 INFO:teuthology.orchestra.run.smithi059:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T19:14:04.555 INFO:teuthology.orchestra.run.smithi155:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T19:14:04.582 INFO:teuthology.orchestra.run.smithi037:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq

Ignoring malparsed backtrace: 2020-08-23T19:14:35.942 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded.
, 2020-08-23T19:14:35.943 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test
, 2020-08-23T19:14:35.945 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-radosgw-2:16.0.0-4625.g5661c49e31d.el8.x86_64     1/1

Ignoring malparsed backtrace: 2020-08-23T19:14:37.894 INFO:teuthology.orchestra.run.smithi155.stdout:  Preparing        :                                                        1/1
, 2020-08-23T19:14:37.906 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : ceph-test-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/5
, 2020-08-23T19:14:38.064 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : jq-1.5-12.el8.x86_64                                   2/5

Ignoring malparsed backtrace: 2020-08-23T19:14:40.117 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction
, 2020-08-23T19:14:40.135 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved.
, 2020-08-23T19:14:40.136 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T19:14:42.084 INFO:teuthology.orchestra.run.smithi059.stdout:Removing unused dependencies:
, 2020-08-23T19:14:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T19:14:42.085 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T19:14:42.469 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook                   noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      117 k
, 2020-08-23T19:14:42.470 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror                      x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             14 M
, 2020-08-23T19:14:42.470 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies:

Ignoring malparsed backtrace: 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout:Removing unused dependencies:
, 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T19:14:43.323 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5661c49e31d.el8.noarc    1/85
, 2020-08-23T19:14:43.342 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-mgr-2:16.0.0-4625.g5661c49e31d.el8.x86_64        2/85
, 2020-08-23T19:14:43.343 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : ceph-mgr-2:16.0.0-4625.g5661c49e31d.el8.x86_64        2/85

Ignoring malparsed backtrace: 2020-08-23T19:14:48.073 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : python3-urllib3-1.24.2-2.el8.noarch                  24/85
, 2020-08-23T19:14:48.156 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : python3-portend-2.6-1.el8.noarch                     27/85
, 2020-08-23T19:14:48.198 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : python3-babel-2.5.1-5.el8.noarch                     23/85

Ignoring malparsed backtrace: 2020-08-23T19:14:52.677 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : python3-websocket-client-0.56.0-5.el8.noarch         49/85
, 2020-08-23T19:14:52.747 INFO:teuthology.orchestra.run.smithi037.stdout:  Running scriptlet: ceph-base-2:16.0.0-4625.g5661c49e31d.el8.x86_64      57/85
, 2020-08-23T19:14:52.747 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : ceph-common-2:16.0.0-4625.g5661c49e31d.el8.x86_64    58/85

Ignoring malparsed backtrace: 2020-08-23T19:15:11.014 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : openblas-threads-0.3.3-2.el8.x86_64                  71/85
, 2020-08-23T19:15:11.062 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : python3-rados-2:16.0.0-4625.g5661c49e31d.el8.x86_6   75/85
, 2020-08-23T19:15:11.211 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : libunwind-1.3.1-3.el8.x86_64                         76/85

Ignoring malparsed backtrace: 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-mako-1.0.6-13.el8.noarch                     50/85
, 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-markupsafe-0.23-19.el8.x86_64                51/85
, 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-more-itertools-7.2.0-3.el8.noarch            52/85

Ignoring malparsed backtrace: 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pyasn1-modules-0.3.7-6.el8.noarch            60/85
, 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pysocks-1.6.8-3.el8.noarch                   61/85
, 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pytz-2017.2-9.el8.noarch                     62/85

Ignoring malparsed backtrace: 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-simplegeneric-0.8.1-17.el8.noarch            73/85
, 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-singledispatch-3.4.0.3-18.el8.noarch         74/85
, 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-tempora-1.14.1-5.el8.noarch                  75/85

Ignoring malparsed backtrace: 2020-08-23T19:15:14.561 INFO:teuthology.orchestra.run.smithi037.stdout:Complete!
, 2020-08-23T19:15:15.291 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:15.292 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-waitress-1.2.1-2.el8.1.noarch
, 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-webencodings-0.5.1-6.el8.noarch
, 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-webob-1.8.5-1.el8.1.noarch

Ignoring malparsed backtrace: 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout: Package      Arch        Version                              Repository  Size
, 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================
, 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout:Removing:

Ignoring malparsed backtrace: 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================
, 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:Remove  1 Package
, 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:

Ignoring malparsed backtrace: 2020-08-23T19:15:21.535 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:21.536 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================
, 2020-08-23T19:15:21.536 INFO:teuthology.orchestra.run.smithi037.stdout: Package       Arch     Version                            Repository      Size

Ignoring malparsed backtrace: 2020-08-23T19:15:23.147 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check
, 2020-08-23T19:15:23.148 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded.
, 2020-08-23T19:15:23.148 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test

Ignoring malparsed backtrace: 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel     x86_64    2:16.0.0-4625.g5661c49e31d.el8     @ceph    436 k
, 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout:Removing dependent packages:
, 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel    x86_64    2:16.0.0-4625.g5661c49e31d.el8     @ceph     84 k

Ignoring malparsed backtrace: 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : librados2-2:16.0.0-4625.g5661c49e31d.el8.x86_64        5/7
, 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:warning: file /etc/ceph: remove failed: No such file or directory
, 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:

Ignoring malparsed backtrace: 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:  Running scriptlet: librbd1-2:16.0.0-4625.g5661c49e31d.el8.x86_64          4/7
, 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : librados2-2:16.0.0-4625.g5661c49e31d.el8.x86_64        5/7
, 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:warning: file /etc/ceph: remove failed: No such file or directory

Ignoring malparsed backtrace: No packages marked for removal.
, 2020-08-23T19:15:31.530 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:31.532 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do.

Ignoring malparsed backtrace: 2020-08-23T19:15:35.172 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS
, 2020-08-23T19:15:35.172 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS
, 2020-08-23T19:15:35.173 DEBUG:teuthology.misc:System to be installed: CentOS

Ignoring malparsed backtrace: 2020-08-23T19:16:04.886 INFO:teuthology.task.internal:Transferring binaries for coredumps...
, 2020-08-23T19:16:04.924 INFO:teuthology.orchestra.run.smithi037:> which ceph_test_librbd
, which: no ceph_test_librbd in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin)

Ignoring malparsed backtrace:  ceph version 16.0.0-4625-g5661c49e31d (5661c49e31df2517dd62fef514a6210e37e9b4ac) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f655a3289d8]
,  2: (()+0x276bf2) [0x7f655a328bf2]

Ignoring malparsed backtrace: 2020-08-23T19:13:16.745 INFO:teuthology.orchestra.run.smithi059.stdout:}
, 2020-08-23T19:13:16.754 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub

Ignoring malparsed backtrace: 2020-08-23T19:13:40.444 INFO:tasks.ceph:pgid 55.15 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T19:13:40.445 INFO:tasks.ceph:pgid 55.12 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T19:13:40.445 INFO:tasks.ceph:pgid 55.10 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)

Ignoring malparsed backtrace: 2020-08-23T19:14:04.540 INFO:teuthology.orchestra.run.smithi059:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T19:14:04.555 INFO:teuthology.orchestra.run.smithi155:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T19:14:04.582 INFO:teuthology.orchestra.run.smithi037:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq

Ignoring malparsed backtrace: 2020-08-23T19:14:35.942 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded.
, 2020-08-23T19:14:35.943 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test
, 2020-08-23T19:14:35.945 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-radosgw-2:16.0.0-4625.g5661c49e31d.el8.x86_64     1/1

Ignoring malparsed backtrace: 2020-08-23T19:14:37.894 INFO:teuthology.orchestra.run.smithi155.stdout:  Preparing        :                                                        1/1
, 2020-08-23T19:14:37.906 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : ceph-test-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/5
, 2020-08-23T19:14:38.064 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : jq-1.5-12.el8.x86_64                                   2/5

Ignoring malparsed backtrace: 2020-08-23T19:14:40.117 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction
, 2020-08-23T19:14:40.135 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved.
, 2020-08-23T19:14:40.136 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T19:14:42.084 INFO:teuthology.orchestra.run.smithi059.stdout:Removing unused dependencies:
, 2020-08-23T19:14:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T19:14:42.085 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T19:14:42.469 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook                   noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      117 k
, 2020-08-23T19:14:42.470 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror                      x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             14 M
, 2020-08-23T19:14:42.470 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies:

Ignoring malparsed backtrace: 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout:Removing unused dependencies:
, 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T19:14:43.323 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5661c49e31d.el8.noarc    1/85
, 2020-08-23T19:14:43.342 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-mgr-2:16.0.0-4625.g5661c49e31d.el8.x86_64        2/85
, 2020-08-23T19:14:43.343 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : ceph-mgr-2:16.0.0-4625.g5661c49e31d.el8.x86_64        2/85

Ignoring malparsed backtrace: 2020-08-23T19:14:48.073 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : python3-urllib3-1.24.2-2.el8.noarch                  24/85
, 2020-08-23T19:14:48.156 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : python3-portend-2.6-1.el8.noarch                     27/85
, 2020-08-23T19:14:48.198 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : python3-babel-2.5.1-5.el8.noarch                     23/85

Ignoring malparsed backtrace: 2020-08-23T19:14:52.677 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : python3-websocket-client-0.56.0-5.el8.noarch         49/85
, 2020-08-23T19:14:52.747 INFO:teuthology.orchestra.run.smithi037.stdout:  Running scriptlet: ceph-base-2:16.0.0-4625.g5661c49e31d.el8.x86_64      57/85
, 2020-08-23T19:14:52.747 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : ceph-common-2:16.0.0-4625.g5661c49e31d.el8.x86_64    58/85

Ignoring malparsed backtrace: 2020-08-23T19:15:11.014 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : openblas-threads-0.3.3-2.el8.x86_64                  71/85
, 2020-08-23T19:15:11.062 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : python3-rados-2:16.0.0-4625.g5661c49e31d.el8.x86_6   75/85
, 2020-08-23T19:15:11.211 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : libunwind-1.3.1-3.el8.x86_64                         76/85

Ignoring malparsed backtrace: 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-mako-1.0.6-13.el8.noarch                     50/85
, 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-markupsafe-0.23-19.el8.x86_64                51/85
, 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-more-itertools-7.2.0-3.el8.noarch            52/85

Ignoring malparsed backtrace: 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pyasn1-modules-0.3.7-6.el8.noarch            60/85
, 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pysocks-1.6.8-3.el8.noarch                   61/85
, 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pytz-2017.2-9.el8.noarch                     62/85

Ignoring malparsed backtrace: 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-simplegeneric-0.8.1-17.el8.noarch            73/85
, 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-singledispatch-3.4.0.3-18.el8.noarch         74/85
, 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-tempora-1.14.1-5.el8.noarch                  75/85

Ignoring malparsed backtrace: 2020-08-23T19:15:14.561 INFO:teuthology.orchestra.run.smithi037.stdout:Complete!
, 2020-08-23T19:15:15.291 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:15.292 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-waitress-1.2.1-2.el8.1.noarch
, 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-webencodings-0.5.1-6.el8.noarch
, 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-webob-1.8.5-1.el8.1.noarch

Ignoring malparsed backtrace: 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout: Package      Arch        Version                              Repository  Size
, 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================
, 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout:Removing:

Ignoring malparsed backtrace: 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================
, 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:Remove  1 Package
, 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:

Ignoring malparsed backtrace: 2020-08-23T19:15:21.535 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:21.536 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================
, 2020-08-23T19:15:21.536 INFO:teuthology.orchestra.run.smithi037.stdout: Package       Arch     Version                            Repository      Size

Ignoring malparsed backtrace: 2020-08-23T19:15:23.147 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check
, 2020-08-23T19:15:23.148 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded.
, 2020-08-23T19:15:23.148 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test

Ignoring malparsed backtrace: 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel     x86_64    2:16.0.0-4625.g5661c49e31d.el8     @ceph    436 k
, 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout:Removing dependent packages:
, 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel    x86_64    2:16.0.0-4625.g5661c49e31d.el8     @ceph     84 k

Ignoring malparsed backtrace: 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : librados2-2:16.0.0-4625.g5661c49e31d.el8.x86_64        5/7
, 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:warning: file /etc/ceph: remove failed: No such file or directory
, 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:

Ignoring malparsed backtrace: 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:  Running scriptlet: librbd1-2:16.0.0-4625.g5661c49e31d.el8.x86_64          4/7
, 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : librados2-2:16.0.0-4625.g5661c49e31d.el8.x86_64        5/7
, 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:warning: file /etc/ceph: remove failed: No such file or directory

Ignoring malparsed backtrace: No packages marked for removal.
, 2020-08-23T19:15:31.530 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:31.532 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do.

Ignoring malparsed backtrace: 2020-08-23T19:15:35.172 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS
, 2020-08-23T19:15:35.172 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS
, 2020-08-23T19:15:35.173 DEBUG:teuthology.misc:System to be installed: CentOS

Ignoring malparsed backtrace: 2020-08-23T19:16:04.886 INFO:teuthology.task.internal:Transferring binaries for coredumps...
, 2020-08-23T19:16:04.924 INFO:teuthology.orchestra.run.smithi037:> which ceph_test_librbd
, which: no ceph_test_librbd in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin)

Ignoring malparsed backtrace:  ceph version 16.0.0-4625-g5661c49e31d (5661c49e31df2517dd62fef514a6210e37e9b4ac) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f655a3289d8]
,  2: (()+0x276bf2) [0x7f655a328bf2]

Ignoring malparsed backtrace: 2020-08-23T19:13:16.745 INFO:teuthology.orchestra.run.smithi059.stdout:}
, 2020-08-23T19:13:16.754 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub

Ignoring malparsed backtrace: 2020-08-23T19:13:40.444 INFO:tasks.ceph:pgid 55.15 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T19:13:40.445 INFO:tasks.ceph:pgid 55.12 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T19:13:40.445 INFO:tasks.ceph:pgid 55.10 last_scrub_stamp 2020-08-23T19:12:30.650461+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=12, tm_sec=30, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=19, tm_min=13, tm_sec=14, tm_wday=6, tm_yday=236, tm_isdst=0)

Ignoring malparsed backtrace: 2020-08-23T19:14:04.540 INFO:teuthology.orchestra.run.smithi059:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T19:14:04.555 INFO:teuthology.orchestra.run.smithi155:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T19:14:04.582 INFO:teuthology.orchestra.run.smithi037:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq

Ignoring malparsed backtrace: 2020-08-23T19:14:35.942 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded.
, 2020-08-23T19:14:35.943 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test
, 2020-08-23T19:14:35.945 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-radosgw-2:16.0.0-4625.g5661c49e31d.el8.x86_64     1/1

Ignoring malparsed backtrace: 2020-08-23T19:14:37.894 INFO:teuthology.orchestra.run.smithi155.stdout:  Preparing        :                                                        1/1
, 2020-08-23T19:14:37.906 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : ceph-test-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/5
, 2020-08-23T19:14:38.064 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : jq-1.5-12.el8.x86_64                                   2/5

Ignoring malparsed backtrace: 2020-08-23T19:14:40.117 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction
, 2020-08-23T19:14:40.135 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved.
, 2020-08-23T19:14:40.136 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T19:14:42.084 INFO:teuthology.orchestra.run.smithi059.stdout:Removing unused dependencies:
, 2020-08-23T19:14:42.084 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T19:14:42.085 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T19:14:42.469 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook                   noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      117 k
, 2020-08-23T19:14:42.470 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror                      x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             14 M
, 2020-08-23T19:14:42.470 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies:

Ignoring malparsed backtrace: 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout:Removing unused dependencies:
, 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T19:14:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T19:14:43.323 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5661c49e31d.el8.noarc    1/85
, 2020-08-23T19:14:43.342 INFO:teuthology.orchestra.run.smithi059.stdout:  Running scriptlet: ceph-mgr-2:16.0.0-4625.g5661c49e31d.el8.x86_64        2/85
, 2020-08-23T19:14:43.343 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : ceph-mgr-2:16.0.0-4625.g5661c49e31d.el8.x86_64        2/85

Ignoring malparsed backtrace: 2020-08-23T19:14:48.073 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : python3-urllib3-1.24.2-2.el8.noarch                  24/85
, 2020-08-23T19:14:48.156 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : python3-portend-2.6-1.el8.noarch                     27/85
, 2020-08-23T19:14:48.198 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : python3-babel-2.5.1-5.el8.noarch                     23/85

Ignoring malparsed backtrace: 2020-08-23T19:14:52.677 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : python3-websocket-client-0.56.0-5.el8.noarch         49/85
, 2020-08-23T19:14:52.747 INFO:teuthology.orchestra.run.smithi037.stdout:  Running scriptlet: ceph-base-2:16.0.0-4625.g5661c49e31d.el8.x86_64      57/85
, 2020-08-23T19:14:52.747 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : ceph-common-2:16.0.0-4625.g5661c49e31d.el8.x86_64    58/85

Ignoring malparsed backtrace: 2020-08-23T19:15:11.014 INFO:teuthology.orchestra.run.smithi059.stdout:  Erasing          : openblas-threads-0.3.3-2.el8.x86_64                  71/85
, 2020-08-23T19:15:11.062 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : python3-rados-2:16.0.0-4625.g5661c49e31d.el8.x86_6   75/85
, 2020-08-23T19:15:11.211 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : libunwind-1.3.1-3.el8.x86_64                         76/85

Ignoring malparsed backtrace: 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-mako-1.0.6-13.el8.noarch                     50/85
, 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-markupsafe-0.23-19.el8.x86_64                51/85
, 2020-08-23T19:15:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:  Verifying        : python3-more-itertools-7.2.0-3.el8.noarch            52/85

Ignoring malparsed backtrace: 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pyasn1-modules-0.3.7-6.el8.noarch            60/85
, 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pysocks-1.6.8-3.el8.noarch                   61/85
, 2020-08-23T19:15:13.726 INFO:teuthology.orchestra.run.smithi059.stdout:  Verifying        : python3-pytz-2017.2-9.el8.noarch                     62/85

Ignoring malparsed backtrace: 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-simplegeneric-0.8.1-17.el8.noarch            73/85
, 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-singledispatch-3.4.0.3-18.el8.noarch         74/85
, 2020-08-23T19:15:14.379 INFO:teuthology.orchestra.run.smithi155.stdout:  Verifying        : python3-tempora-1.14.1-5.el8.noarch                  75/85

Ignoring malparsed backtrace: 2020-08-23T19:15:14.561 INFO:teuthology.orchestra.run.smithi037.stdout:Complete!
, 2020-08-23T19:15:15.291 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:15.292 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-waitress-1.2.1-2.el8.1.noarch
, 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-webencodings-0.5.1-6.el8.noarch
, 2020-08-23T19:15:15.396 INFO:teuthology.orchestra.run.smithi059.stdout:  python3-webob-1.8.5-1.el8.1.noarch

Ignoring malparsed backtrace: 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout: Package      Arch        Version                              Repository  Size
, 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================
, 2020-08-23T19:15:16.160 INFO:teuthology.orchestra.run.smithi059.stdout:Removing:

Ignoring malparsed backtrace: 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================
, 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:Remove  1 Package
, 2020-08-23T19:15:18.511 INFO:teuthology.orchestra.run.smithi059.stdout:

Ignoring malparsed backtrace: 2020-08-23T19:15:21.535 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:21.536 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================
, 2020-08-23T19:15:21.536 INFO:teuthology.orchestra.run.smithi037.stdout: Package       Arch     Version                            Repository      Size

Ignoring malparsed backtrace: 2020-08-23T19:15:23.147 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check
, 2020-08-23T19:15:23.148 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded.
, 2020-08-23T19:15:23.148 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test

Ignoring malparsed backtrace: 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel     x86_64    2:16.0.0-4625.g5661c49e31d.el8     @ceph    436 k
, 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout:Removing dependent packages:
, 2020-08-23T19:15:24.905 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel    x86_64    2:16.0.0-4625.g5661c49e31d.el8     @ceph     84 k

Ignoring malparsed backtrace: 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:  Erasing          : librados2-2:16.0.0-4625.g5661c49e31d.el8.x86_64        5/7
, 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:warning: file /etc/ceph: remove failed: No such file or directory
, 2020-08-23T19:15:27.194 INFO:teuthology.orchestra.run.smithi037.stdout:

Ignoring malparsed backtrace: 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:  Running scriptlet: librbd1-2:16.0.0-4625.g5661c49e31d.el8.x86_64          4/7
, 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:  Erasing          : librados2-2:16.0.0-4625.g5661c49e31d.el8.x86_64        5/7
, 2020-08-23T19:15:28.905 INFO:teuthology.orchestra.run.smithi155.stdout:warning: file /etc/ceph: remove failed: No such file or directory

Ignoring malparsed backtrace: No packages marked for removal.
, 2020-08-23T19:15:31.530 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved.
, 2020-08-23T19:15:31.532 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do.

Ignoring malparsed backtrace: 2020-08-23T19:15:35.172 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS
, 2020-08-23T19:15:35.172 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS
, 2020-08-23T19:15:35.173 DEBUG:teuthology.misc:System to be installed: CentOS

Ignoring malparsed backtrace: 2020-08-23T19:16:04.886 INFO:teuthology.task.internal:Transferring binaries for coredumps...
, 2020-08-23T19:16:04.924 INFO:teuthology.orchestra.run.smithi037:> which ceph_test_librbd
, which: no ceph_test_librbd in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin)

Ignoring malparsed backtrace:  ceph version 16.0.0-4625-g5661c49e31d (5661c49e31df2517dd62fef514a6210e37e9b4ac) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f46062bc9d8]
,  2: (()+0x276bf2) [0x7f46062bcbf2]

Ignoring malparsed backtrace: 2020-08-23T22:25:01.499 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub
, 2020-08-23T22:25:01.780 INFO:tasks.ceph:Scrubbing osd.2

Ignoring malparsed backtrace: 2020-08-23T22:25:24.935 INFO:tasks.ceph:pgid 71.18 last_scrub_stamp 2020-08-23T22:24:17.404754+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=17, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=59, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T22:25:24.935 INFO:tasks.ceph:pgid 71.e last_scrub_stamp 2020-08-23T22:24:17.404754+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=17, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=59, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T22:25:24.935 INFO:tasks.ceph:pgid 71.a last_scrub_stamp 2020-08-23T22:24:17.404754+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=17, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=59, tm_wday=6, tm_yday=236, tm_isdst=0)

Ignoring malparsed backtrace: 2020-08-23T22:25:49.338 INFO:teuthology.orchestra.run.smithi112:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T22:25:49.340 INFO:teuthology.orchestra.run.smithi135:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, gzip: /var/log/ceph/valgrind/*.gz: No such file or directory

Ignoring malparsed backtrace: 2020-08-23T22:26:23.783 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test
, 2020-08-23T22:26:23.787 INFO:teuthology.orchestra.run.smithi112.stdout:  Preparing        :                                                        1/1
, 2020-08-23T22:26:23.809 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded.

Ignoring malparsed backtrace: 2020-08-23T22:26:25.674 INFO:teuthology.orchestra.run.smithi135.stdout:  Preparing        :                                                        1/1
, 2020-08-23T22:26:25.689 INFO:teuthology.orchestra.run.smithi112.stdout:  Erasing          : ceph-test-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/5
, 2020-08-23T22:26:25.858 INFO:teuthology.orchestra.run.smithi114.stdout:  Erasing          : ceph-test-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/5

Ignoring malparsed backtrace: 2020-08-23T22:26:27.770 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction
, 2020-08-23T22:26:27.885 INFO:teuthology.orchestra.run.smithi114.stdout:  Preparing        :                                                        1/1
, 2020-08-23T22:26:27.892 INFO:teuthology.orchestra.run.smithi114.stdout:  Running scriptlet: ceph-2:16.0.0-4625.g5661c49e31d.el8.x86_64             1/1

Ignoring malparsed backtrace: 2020-08-23T22:26:29.728 INFO:teuthology.orchestra.run.smithi112.stdout:Removing unused dependencies:
, 2020-08-23T22:26:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T22:26:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T22:26:29.868 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook                   noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      117 k
, 2020-08-23T22:26:29.868 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror                      x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             14 M
, 2020-08-23T22:26:29.868 INFO:teuthology.orchestra.run.smithi114.stdout:Removing unused dependencies:

Ignoring malparsed backtrace: 2020-08-23T22:26:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base                       x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             28 M
, 2020-08-23T22:26:30.430 INFO:teuthology.orchestra.run.smithi135.stdout:Removing dependent packages:
, 2020-08-23T22:26:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook                   noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      117 k

Ignoring malparsed backtrace: 2020-08-23T22:26:30.873 INFO:teuthology.orchestra.run.smithi114.stdout:  Preparing        :                                                        1/1
, 2020-08-23T22:26:30.898 INFO:teuthology.orchestra.run.smithi112.stdout:  Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5661c49e31d.el8.noarc    1/85
, 2020-08-23T22:26:30.902 INFO:teuthology.orchestra.run.smithi114.stdout:  Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5661c49e31d.el8.noarch    1/1

Ignoring malparsed backtrace: 2020-08-23T22:26:35.988 INFO:teuthology.orchestra.run.smithi112.stdout:  Erasing          : python3-tempora-1.14.1-5.el8.noarch                  28/85
, 2020-08-23T22:26:36.033 INFO:teuthology.orchestra.run.smithi135.stdout:  Erasing          : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f   19/85
, 2020-08-23T22:26:36.056 INFO:teuthology.orchestra.run.smithi135.stdout:  Running scriptlet: rbd-mirror-2:16.0.0-4625.g5661c49e31d.el8.x86_64     20/85

Ignoring malparsed backtrace: 2020-08-23T22:26:40.812 INFO:teuthology.orchestra.run.smithi112.stdout:  Running scriptlet: ceph-base-2:16.0.0-4625.g5661c49e31d.el8.x86_64      57/85
, 2020-08-23T22:26:40.812 INFO:teuthology.orchestra.run.smithi112.stdout:  Erasing          : ceph-common-2:16.0.0-4625.g5661c49e31d.el8.x86_64    58/85
, 2020-08-23T22:26:40.812 INFO:teuthology.orchestra.run.smithi112.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy

Ignoring malparsed backtrace: 2020-08-23T22:26:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:  Erasing          : librabbitmq-0.9.0-1.el8.x86_64                       79/85
, 2020-08-23T22:26:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:  Erasing          : librdkafka-0.11.4-1.el8.x86_64                       80/85
, 2020-08-23T22:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout:  Erasing          : python3-rbd-2:16.0.0-4625.g5661c49e31d.el8.x86_64    74/85

Ignoring malparsed backtrace: 2020-08-23T22:26:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:  Verifying        : python3-webtest-2.0.33-1.el8.noarch                  82/85
, 2020-08-23T22:26:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:  Verifying        : python3-werkzeug-0.12.2-4.el8.noarch                 83/85
, 2020-08-23T22:26:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:  Verifying        : python3-zc-lockfile-2.0-2.el8.noarch                 84/85

Ignoring malparsed backtrace: 2020-08-23T22:27:00.606 INFO:teuthology.orchestra.run.smithi112.stdout:  Verifying        : python3-urllib3-1.24.2-2.el8.noarch                  77/85
, 2020-08-23T22:27:00.606 INFO:teuthology.orchestra.run.smithi112.stdout:  Verifying        : python3-waitress-1.2.1-2.el8.1.noarch                78/85
, 2020-08-23T22:27:00.606 INFO:teuthology.orchestra.run.smithi112.stdout:  Verifying        : python3-webencodings-0.5.1-6.el8.noarch              79/85

Ignoring malparsed backtrace: 2020-08-23T22:27:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:Complete!
, 2020-08-23T22:27:01.288 INFO:teuthology.orchestra.run.smithi135.stdout:  Erasing          : python3-rbd-2:16.0.0-4625.g5661c49e31d.el8.x86_64    74/85
, 2020-08-23T22:27:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:  Erasing          : python3-rados-2:16.0.0-4625.g5661c49e31d.el8.x86_6   75/85

Ignoring malparsed backtrace: 2020-08-23T22:27:02.251 INFO:teuthology.orchestra.run.smithi112.stdout:  python3-rgw-2:16.0.0-4625.g5661c49e31d.el8.x86_64
, 2020-08-23T22:27:02.251 INFO:teuthology.orchestra.run.smithi112.stdout:  python3-routes-2.4.1-12.el8.noarch
, 2020-08-23T22:27:02.251 INFO:teuthology.orchestra.run.smithi112.stdout:  python3-rsa-3.4.2-15.el8.noarch

Ignoring malparsed backtrace: 2020-08-23T22:27:03.581 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : python3-kubernetes-11.0.0-2.el8.noarch               47/85
, 2020-08-23T22:27:03.591 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : python3-logutils-0.3.5-11.el8.noarch                 48/85
, 2020-08-23T22:27:03.591 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : python3-lxml-4.2.3-1.el8.x86_64                      49/85

Ignoring malparsed backtrace: 2020-08-23T22:27:05.206 INFO:teuthology.orchestra.run.smithi135.stdout:  ceph-mgr-diskprediction-local-2:16.0.0-4625.g5661c49e31d.el8.noarch
, 2020-08-23T22:27:05.207 INFO:teuthology.orchestra.run.smithi135.stdout:  ceph-mgr-modules-core-2:16.0.0-4625.g5661c49e31d.el8.noarch
, 2020-08-23T22:27:05.207 INFO:teuthology.orchestra.run.smithi135.stdout:  ceph-prometheus-alerts-2:16.0.0-4625.g5661c49e31d.el8.noarch

Ignoring malparsed backtrace: 2020-08-23T22:27:05.886 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 186 k
, 2020-08-23T22:27:05.887 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check
, 2020-08-23T22:27:05.889 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded.

Ignoring malparsed backtrace: 2020-08-23T22:27:08.245 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded.
, 2020-08-23T22:27:08.245 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test
, 2020-08-23T22:27:08.271 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded.

Ignoring malparsed backtrace: 2020-08-23T22:27:10.281 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: ceph-mgr-dashboard
, No packages marked for removal.
, 2020-08-23T22:27:10.285 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved.

Ignoring malparsed backtrace: 2020-08-23T22:27:12.366 INFO:teuthology.orchestra.run.smithi135.stdout:  Erasing          : ceph-fuse-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/3
, 2020-08-23T22:27:12.493 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved.
, 2020-08-23T22:27:12.495 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T22:27:14.038 INFO:teuthology.orchestra.run.smithi114.stdout:  Verifying        : rbd-fuse-2:16.0.0-4625.g5661c49e31d.el8.x86_64         6/7
, 2020-08-23T22:27:14.063 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved.
, 2020-08-23T22:27:14.065 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T22:27:16.120 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do.
, 2020-08-23T22:27:16.120 INFO:teuthology.orchestra.run.smithi112.stdout:Complete!
, 2020-08-23T22:27:16.455 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: libcephfs-devel

Ignoring malparsed backtrace: 2020-08-23T22:27:18.760 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : librbd1-2:16.0.0-4625.g5661c49e31d.el8.x86_64          3/7
, 2020-08-23T22:27:18.760 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : lttng-ust-2.8.1-11.el8.x86_64                          4/7
, 2020-08-23T22:27:18.760 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+d   5/7

Ignoring malparsed backtrace: 2020-08-23T22:27:24.236 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS
, 2020-08-23T22:27:24.237 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS
, 2020-08-23T22:27:24.237 DEBUG:teuthology.misc:System to be installed: CentOS

Ignoring malparsed backtrace: 2020-08-23T22:27:53.270 INFO:teuthology.task.internal:Transferring binaries for coredumps...
, 2020-08-23T22:27:53.307 INFO:teuthology.orchestra.run.smithi114:> which ceph_test_librbd
, which: no ceph_test_librbd in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin)

Ignoring malparsed backtrace:  ceph version 16.0.0-4625-g5661c49e31d (5661c49e31df2517dd62fef514a6210e37e9b4ac) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f46062bc9d8]
,  2: (()+0x276bf2) [0x7f46062bcbf2]

Ignoring malparsed backtrace: 2020-08-23T22:25:01.499 INFO:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub
, 2020-08-23T22:25:01.780 INFO:tasks.ceph:Scrubbing osd.2

Ignoring malparsed backtrace: 2020-08-23T22:25:24.935 INFO:tasks.ceph:pgid 71.18 last_scrub_stamp 2020-08-23T22:24:17.404754+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=17, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=59, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T22:25:24.935 INFO:tasks.ceph:pgid 71.e last_scrub_stamp 2020-08-23T22:24:17.404754+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=17, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=59, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T22:25:24.935 INFO:tasks.ceph:pgid 71.a last_scrub_stamp 2020-08-23T22:24:17.404754+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=17, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=22, tm_min=24, tm_sec=59, tm_wday=6, tm_yday=236, tm_isdst=0)

Ignoring malparsed backtrace: 2020-08-23T22:25:49.338 INFO:teuthology.orchestra.run.smithi112:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, 2020-08-23T22:25:49.340 INFO:teuthology.orchestra.run.smithi135:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
, gzip: /var/log/ceph/valgrind/*.gz: No such file or directory

Ignoring malparsed backtrace: 2020-08-23T22:26:23.783 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test
, 2020-08-23T22:26:23.787 INFO:teuthology.orchestra.run.smithi112.stdout:  Preparing        :                                                        1/1
, 2020-08-23T22:26:23.809 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded.

Ignoring malparsed backtrace: 2020-08-23T22:26:25.674 INFO:teuthology.orchestra.run.smithi135.stdout:  Preparing        :                                                        1/1
, 2020-08-23T22:26:25.689 INFO:teuthology.orchestra.run.smithi112.stdout:  Erasing          : ceph-test-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/5
, 2020-08-23T22:26:25.858 INFO:teuthology.orchestra.run.smithi114.stdout:  Erasing          : ceph-test-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/5

Ignoring malparsed backtrace: 2020-08-23T22:26:27.770 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction
, 2020-08-23T22:26:27.885 INFO:teuthology.orchestra.run.smithi114.stdout:  Preparing        :                                                        1/1
, 2020-08-23T22:26:27.892 INFO:teuthology.orchestra.run.smithi114.stdout:  Running scriptlet: ceph-2:16.0.0-4625.g5661c49e31d.el8.x86_64             1/1

Ignoring malparsed backtrace: 2020-08-23T22:26:29.728 INFO:teuthology.orchestra.run.smithi112.stdout:Removing unused dependencies:
, 2020-08-23T22:26:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common                     x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             85 M
, 2020-08-23T22:26:29.729 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards         noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      221 k

Ignoring malparsed backtrace: 2020-08-23T22:26:29.868 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook                   noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      117 k
, 2020-08-23T22:26:29.868 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror                      x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             14 M
, 2020-08-23T22:26:29.868 INFO:teuthology.orchestra.run.smithi114.stdout:Removing unused dependencies:

Ignoring malparsed backtrace: 2020-08-23T22:26:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base                       x86_642:16.0.0-4625.g5661c49e31d.el8       @ceph             28 M
, 2020-08-23T22:26:30.430 INFO:teuthology.orchestra.run.smithi135.stdout:Removing dependent packages:
, 2020-08-23T22:26:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook                   noarch2:16.0.0-4625.g5661c49e31d.el8       @ceph-noarch      117 k

Ignoring malparsed backtrace: 2020-08-23T22:26:30.873 INFO:teuthology.orchestra.run.smithi114.stdout:  Preparing        :                                                        1/1
, 2020-08-23T22:26:30.898 INFO:teuthology.orchestra.run.smithi112.stdout:  Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5661c49e31d.el8.noarc    1/85
, 2020-08-23T22:26:30.902 INFO:teuthology.orchestra.run.smithi114.stdout:  Running scriptlet: ceph-mgr-rook-2:16.0.0-4625.g5661c49e31d.el8.noarch    1/1

Ignoring malparsed backtrace: 2020-08-23T22:26:35.988 INFO:teuthology.orchestra.run.smithi112.stdout:  Erasing          : python3-tempora-1.14.1-5.el8.noarch                  28/85
, 2020-08-23T22:26:36.033 INFO:teuthology.orchestra.run.smithi135.stdout:  Erasing          : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f   19/85
, 2020-08-23T22:26:36.056 INFO:teuthology.orchestra.run.smithi135.stdout:  Running scriptlet: rbd-mirror-2:16.0.0-4625.g5661c49e31d.el8.x86_64     20/85

Ignoring malparsed backtrace: 2020-08-23T22:26:40.812 INFO:teuthology.orchestra.run.smithi112.stdout:  Running scriptlet: ceph-base-2:16.0.0-4625.g5661c49e31d.el8.x86_64      57/85
, 2020-08-23T22:26:40.812 INFO:teuthology.orchestra.run.smithi112.stdout:  Erasing          : ceph-common-2:16.0.0-4625.g5661c49e31d.el8.x86_64    58/85
, 2020-08-23T22:26:40.812 INFO:teuthology.orchestra.run.smithi112.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy

Ignoring malparsed backtrace: 2020-08-23T22:26:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:  Erasing          : librabbitmq-0.9.0-1.el8.x86_64                       79/85
, 2020-08-23T22:26:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:  Erasing          : librdkafka-0.11.4-1.el8.x86_64                       80/85
, 2020-08-23T22:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout:  Erasing          : python3-rbd-2:16.0.0-4625.g5661c49e31d.el8.x86_64    74/85

Ignoring malparsed backtrace: 2020-08-23T22:26:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:  Verifying        : python3-webtest-2.0.33-1.el8.noarch                  82/85
, 2020-08-23T22:26:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:  Verifying        : python3-werkzeug-0.12.2-4.el8.noarch                 83/85
, 2020-08-23T22:26:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:  Verifying        : python3-zc-lockfile-2.0-2.el8.noarch                 84/85

Ignoring malparsed backtrace: 2020-08-23T22:27:00.606 INFO:teuthology.orchestra.run.smithi112.stdout:  Verifying        : python3-urllib3-1.24.2-2.el8.noarch                  77/85
, 2020-08-23T22:27:00.606 INFO:teuthology.orchestra.run.smithi112.stdout:  Verifying        : python3-waitress-1.2.1-2.el8.1.noarch                78/85
, 2020-08-23T22:27:00.606 INFO:teuthology.orchestra.run.smithi112.stdout:  Verifying        : python3-webencodings-0.5.1-6.el8.noarch              79/85

Ignoring malparsed backtrace: 2020-08-23T22:27:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:Complete!
, 2020-08-23T22:27:01.288 INFO:teuthology.orchestra.run.smithi135.stdout:  Erasing          : python3-rbd-2:16.0.0-4625.g5661c49e31d.el8.x86_64    74/85
, 2020-08-23T22:27:01.455 INFO:teuthology.orchestra.run.smithi135.stdout:  Erasing          : python3-rados-2:16.0.0-4625.g5661c49e31d.el8.x86_6   75/85

Ignoring malparsed backtrace: 2020-08-23T22:27:02.251 INFO:teuthology.orchestra.run.smithi112.stdout:  python3-rgw-2:16.0.0-4625.g5661c49e31d.el8.x86_64
, 2020-08-23T22:27:02.251 INFO:teuthology.orchestra.run.smithi112.stdout:  python3-routes-2.4.1-12.el8.noarch
, 2020-08-23T22:27:02.251 INFO:teuthology.orchestra.run.smithi112.stdout:  python3-rsa-3.4.2-15.el8.noarch

Ignoring malparsed backtrace: 2020-08-23T22:27:03.581 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : python3-kubernetes-11.0.0-2.el8.noarch               47/85
, 2020-08-23T22:27:03.591 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : python3-logutils-0.3.5-11.el8.noarch                 48/85
, 2020-08-23T22:27:03.591 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : python3-lxml-4.2.3-1.el8.x86_64                      49/85

Ignoring malparsed backtrace: 2020-08-23T22:27:05.206 INFO:teuthology.orchestra.run.smithi135.stdout:  ceph-mgr-diskprediction-local-2:16.0.0-4625.g5661c49e31d.el8.noarch
, 2020-08-23T22:27:05.207 INFO:teuthology.orchestra.run.smithi135.stdout:  ceph-mgr-modules-core-2:16.0.0-4625.g5661c49e31d.el8.noarch
, 2020-08-23T22:27:05.207 INFO:teuthology.orchestra.run.smithi135.stdout:  ceph-prometheus-alerts-2:16.0.0-4625.g5661c49e31d.el8.noarch

Ignoring malparsed backtrace: 2020-08-23T22:27:05.886 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 186 k
, 2020-08-23T22:27:05.887 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check
, 2020-08-23T22:27:05.889 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded.

Ignoring malparsed backtrace: 2020-08-23T22:27:08.245 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded.
, 2020-08-23T22:27:08.245 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test
, 2020-08-23T22:27:08.271 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded.

Ignoring malparsed backtrace: 2020-08-23T22:27:10.281 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: ceph-mgr-dashboard
, No packages marked for removal.
, 2020-08-23T22:27:10.285 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved.

Ignoring malparsed backtrace: 2020-08-23T22:27:12.366 INFO:teuthology.orchestra.run.smithi135.stdout:  Erasing          : ceph-fuse-2:16.0.0-4625.g5661c49e31d.el8.x86_64        1/3
, 2020-08-23T22:27:12.493 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved.
, 2020-08-23T22:27:12.495 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T22:27:14.038 INFO:teuthology.orchestra.run.smithi114.stdout:  Verifying        : rbd-fuse-2:16.0.0-4625.g5661c49e31d.el8.x86_64         6/7
, 2020-08-23T22:27:14.063 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved.
, 2020-08-23T22:27:14.065 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================

Ignoring malparsed backtrace: 2020-08-23T22:27:16.120 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do.
, 2020-08-23T22:27:16.120 INFO:teuthology.orchestra.run.smithi112.stdout:Complete!
, 2020-08-23T22:27:16.455 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: libcephfs-devel

Ignoring malparsed backtrace: 2020-08-23T22:27:18.760 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : librbd1-2:16.0.0-4625.g5661c49e31d.el8.x86_64          3/7
, 2020-08-23T22:27:18.760 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : lttng-ust-2.8.1-11.el8.x86_64                          4/7
, 2020-08-23T22:27:18.760 INFO:teuthology.orchestra.run.smithi135.stdout:  Verifying        : qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+d   5/7

Ignoring malparsed backtrace: 2020-08-23T22:27:24.236 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS
, 2020-08-23T22:27:24.237 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS
, 2020-08-23T22:27:24.237 DEBUG:teuthology.misc:System to be installed: CentOS

Ignoring malparsed backtrace: 2020-08-23T22:27:53.270 INFO:teuthology.task.internal:Transferring binaries for coredumps...
, 2020-08-23T22:27:53.307 INFO:teuthology.orchestra.run.smithi114:> which ceph_test_librbd
, which: no ceph_test_librbd in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin)

Ignoring malparsed backtrace:  ceph version 16.0.0-4625-g5661c49e31d (5661c49e31df2517dd62fef514a6210e37e9b4ac) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f98eb705dc9]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f98eb705fa4]

Ignoring malparsed backtrace: 2020-08-23T17:11:21.905 INFO:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub
, 2020-08-23T17:11:22.197 INFO:tasks.ceph:Scrubbing osd.2

Ignoring malparsed backtrace: 2020-08-23T17:11:45.565 INFO:tasks.ceph:pgid 96.10 last_scrub_stamp 2020-08-23T17:10:37.913945+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=17, tm_min=11, tm_sec=20, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T17:11:45.565 INFO:tasks.ceph:pgid 96.f last_scrub_stamp 2020-08-23T17:10:37.913945+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=17, tm_min=11, tm_sec=20, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T17:11:45.566 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed.

Ignoring malparsed backtrace: gzip: /var/log/ceph/valgrind/*.gz: No such file or directory
, 2020-08-23T17:12:10.350 INFO:tasks.ceph:Archiving crash dumps...
, 2020-08-23T17:12:10.352 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/trociny-2020-08-23_15:36:46-rbd-wip-mgolub-testing-2-distro-basic-smithi/5369337/remote/smithi083/crash

Ignoring malparsed backtrace: (Reading database ... 45%
, (Reading database ... 50%
, (Reading database ... 55%

Ignoring malparsed backtrace: (Reading database ... 40%
, (Reading database ... 45%
, (Reading database ... 50%

Ignoring malparsed backtrace: (Reading database ... 85%
, (Reading database ... 90%
, (Reading database ... 95%

Ignoring malparsed backtrace: (Reading database ... 90%
, (Reading database ... 95%
, (Reading database ... 100%

Ignoring malparsed backtrace: 2020-08-23T17:13:03.599 INFO:teuthology.orchestra.run.smithi027.stdout:Purging configuration files for ceph-mds (16.0.0-4625-g5661c49e31d-1bionic) ...
, W: --force-yes is deprecated, use one of the options starting with --allow instead.
, 2020-08-23T17:13:04.428 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists...

Ignoring malparsed backtrace: (Reading database ... 5%
, (Reading database ... 10%
, (Reading database ... 15%

Ignoring malparsed backtrace: (Reading database ... 45%
, (Reading database ... 50%
, (Reading database ... 55%

Ignoring malparsed backtrace: (Reading database ... 20%
, (Reading database ... 25%
, (Reading database ... 30%

Ignoring malparsed backtrace: 2020-08-23T17:13:13.171 INFO:teuthology.orchestra.run.smithi083.stdout:Removing ceph-test (16.0.0-4625-g5661c49e31d-1bionic) ...
, 2020-08-23T17:13:13.492 INFO:teuthology.orchestra.run.smithi094.stdout:Removing ceph-common (16.0.0-4625-g5661c49e31d-1bionic) ...
, 2020-08-23T17:13:13.597 INFO:teuthology.orchestra.run.smithi094.stdout:dpkg: warning: while removing ceph-common, unable to remove directory '/var/lib/ceph': Device or resource busy - directory may be a mount point?

Ignoring malparsed backtrace: 2020-08-23T17:13:18.927 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for ureadahead (0.100.0-21) ...
, 2020-08-23T17:13:18.938 INFO:teuthology.orchestra.run.smithi027.stdout:Purging configuration files for radosgw (16.0.0-4625-g5661c49e31d-1bionic) ...
, 2020-08-23T17:13:19.285 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for systemd (237-3ubuntu10.42) ...

Ignoring malparsed backtrace: (Reading database ... 70%
, (Reading database ... 75%
, (Reading database ... 80%

Ignoring malparsed backtrace: (Reading database ... 90%
, (Reading database ... 95%
, (Reading database ... 100%

Ignoring malparsed backtrace: 2020-08-23T17:13:23.411 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-simplegeneric python3-simplejson python3-singledispatch
, 2020-08-23T17:13:23.412 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita
, 2020-08-23T17:13:23.412 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-tz python3-uritemplate python3-waitress python3-webencodings

Ignoring malparsed backtrace: (Reading database ... 60%
, (Reading database ... 65%
, (Reading database ... 70%

Ignoring malparsed backtrace: 2020-08-23T17:13:25.471 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-markupsafe python3-matplotlib python3-monotonic python3-numpy
, 2020-08-23T17:13:25.471 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-oauth2client python3-olefile python3-paste python3-pastedeploy
, 2020-08-23T17:13:25.471 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-pastescript python3-pecan python3-pil python3-pluggy

Ignoring malparsed backtrace: 2020-08-23T17:13:27.012 INFO:teuthology.orchestra.run.smithi094.stdout:  libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr
, 2020-08-23T17:13:27.013 INFO:teuthology.orchestra.run.smithi094.stdout:  python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest
, 2020-08-23T17:13:27.013 INFO:teuthology.orchestra.run.smithi094.stdout:  python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse

Ignoring malparsed backtrace: 2020-08-23T17:13:28.064 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 1,252 kB disk space will be freed.
, 2020-08-23T17:13:28.165 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... 
, (Reading database ... 5%

Ignoring malparsed backtrace: 2020-08-23T17:13:29.123 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree...
, 2020-08-23T17:13:29.123 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information...
, 2020-08-23T17:13:29.216 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree...

Ignoring malparsed backtrace: 2020-08-23T17:13:29.857 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... 
, (Reading database ... 5%
, (Reading database ... 10%

Ignoring malparsed backtrace: (Reading database ... 90%
, (Reading database ... 95%
, (Reading database ... 100%

Ignoring malparsed backtrace: 2020-08-23T17:13:32.551 INFO:teuthology.orchestra.run.smithi083.stdout:  libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1
, 2020-08-23T17:13:32.551 INFO:teuthology.orchestra.run.smithi083.stdout:  libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0
, 2020-08-23T17:13:32.551 INFO:teuthology.orchestra.run.smithi083.stdout:  libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libjq1

Ignoring malparsed backtrace: 2020-08-23T17:13:33.444 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tz
, 2020-08-23T17:13:33.444 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-uritemplate python3-waitress python3-webencodings python3-webob
, 2020-08-23T17:13:33.445 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-websocket python3-webtest python3-werkzeug socat xmlstarlet

Ignoring malparsed backtrace: (Reading database ... 45%
, (Reading database ... 50%
, (Reading database ... 55%

Ignoring malparsed backtrace: 2020-08-23T17:13:39.948 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy
, 2020-08-23T17:13:39.948 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-simplegeneric python3-simplejson python3-singledispatch
, 2020-08-23T17:13:39.948 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita

Ignoring malparsed backtrace: 2020-08-23T17:13:40.537 INFO:teuthology.orchestra.run.smithi094.stdout:  python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes
, 2020-08-23T17:13:40.537 INFO:teuthology.orchestra.run.smithi094.stdout:  python3-logutils python3-lxml python3-mako python3-markupsafe
, 2020-08-23T17:13:40.537 INFO:teuthology.orchestra.run.smithi094.stdout:  python3-matplotlib python3-monotonic python3-numpy python3-oauth2client

Ignoring malparsed backtrace: (Reading database ... 65%
, (Reading database ... 70%
, (Reading database ... 75%

Ignoring malparsed backtrace: 2020-08-23T17:13:42.488 INFO:teuthology.orchestra.run.smithi027.stdout:  libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1
, 2020-08-23T17:13:42.488 INFO:teuthology.orchestra.run.smithi027.stdout:  libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0
, 2020-08-23T17:13:42.488 INFO:teuthology.orchestra.run.smithi027.stdout:  libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libjq1

Ignoring malparsed backtrace: 2020-08-23T17:13:43.814 INFO:teuthology.orchestra.run.smithi027.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/restful' not empty so not removed
, 2020-08-23T17:13:43.814 INFO:teuthology.orchestra.run.smithi027.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/rbd_support' not empty so not removed
, 2020-08-23T17:13:43.814 INFO:teuthology.orchestra.run.smithi027.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/prometheus' not empty so not removed

Ignoring malparsed backtrace: 2020-08-23T17:13:55.004 INFO:teuthology.orchestra.run.smithi083.stdout:Removing libsamplerate0:amd64 (0.1.9-1) ...
, 2020-08-23T17:13:55.140 INFO:teuthology.orchestra.run.smithi027.stdout:Removing libopus0:amd64 (1.1.2-1ubuntu1) ...
, 2020-08-23T17:13:55.336 INFO:teuthology.orchestra.run.smithi094.stdout:Removing libshout3:amd64 (2.4.1-2build1) ...

Ignoring malparsed backtrace: 2020-08-23T17:14:09.277 INFO:teuthology.orchestra.run.smithi027.stdout:Removing python-py (1.5.2-1) ...
, 2020-08-23T17:14:09.490 INFO:teuthology.orchestra.run.smithi083.stdout:Removing python3-ceph-argparse (16.0.0-4625-g5661c49e31d-1bionic) ...
, 2020-08-23T17:14:09.598 INFO:teuthology.orchestra.run.smithi094.stdout:Removing python3-ceph-argparse (16.0.0-4625-g5661c49e31d-1bionic) ...

Ignoring malparsed backtrace: 2020-08-23T17:14:26.399 INFO:teuthology.orchestra.run.smithi083.stdout:Removing python3-pyasn1 (0.4.2-3) ...
, 2020-08-23T17:14:26.607 INFO:teuthology.orchestra.run.smithi094.stdout:Removing python3-pyinotify (0.9.6-1) ...
, 2020-08-23T17:14:26.635 INFO:teuthology.orchestra.run.smithi027.stdout:Removing python3-prettytable (0.7.2-3) ...

Ignoring malparsed backtrace: 2020-08-23T17:14:39.852 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
, 2020-08-23T17:14:39.853 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
, 2020-08-23T17:14:40.106 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]

Ignoring malparsed backtrace:     r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run
,     r.wait()

Ignoring malparsed backtrace:  ceph version 16.0.0-4625-g5661c49e31d (5661c49e31df2517dd62fef514a6210e37e9b4ac) pacific (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f98eb705dc9]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f98eb705fa4]

Ignoring malparsed backtrace: 2020-08-23T17:11:21.905 INFO:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub
, 2020-08-23T17:11:22.197 INFO:tasks.ceph:Scrubbing osd.2

Ignoring malparsed backtrace: 2020-08-23T17:11:45.565 INFO:tasks.ceph:pgid 96.10 last_scrub_stamp 2020-08-23T17:10:37.913945+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=17, tm_min=11, tm_sec=20, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T17:11:45.565 INFO:tasks.ceph:pgid 96.f last_scrub_stamp 2020-08-23T17:10:37.913945+0000 time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=6, tm_yday=236, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=8, tm_mday=23, tm_hour=17, tm_min=11, tm_sec=20, tm_wday=6, tm_yday=236, tm_isdst=0)
, 2020-08-23T17:11:45.566 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed.

Ignoring malparsed backtrace: gzip: /var/log/ceph/valgrind/*.gz: No such file or directory
, 2020-08-23T17:12:10.350 INFO:tasks.ceph:Archiving crash dumps...
, 2020-08-23T17:12:10.352 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/trociny-2020-08-23_15:36:46-rbd-wip-mgolub-testing-2-distro-basic-smithi/5369337/remote/smithi083/crash

Ignoring malparsed backtrace: (Reading database ... 45%
, (Reading database ... 50%
, (Reading database ... 55%

Ignoring malparsed backtrace: (Reading database ... 40%
, (Reading database ... 45%
, (Reading database ... 50%

Ignoring malparsed backtrace: (Reading database ... 85%
, (Reading database ... 90%
, (Reading database ... 95%

Ignoring malparsed backtrace: (Reading database ... 90%
, (Reading database ... 95%
, (Reading database ... 100%

Ignoring malparsed backtrace: 2020-08-23T17:13:03.599 INFO:teuthology.orchestra.run.smithi027.stdout:Purging configuration files for ceph-mds (16.0.0-4625-g5661c49e31d-1bionic) ...
, W: --force-yes is deprecated, use one of the options starting with --allow instead.
, 2020-08-23T17:13:04.428 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists...

Ignoring malparsed backtrace: (Reading database ... 5%
, (Reading database ... 10%
, (Reading database ... 15%

Ignoring malparsed backtrace: (Reading database ... 45%
, (Reading database ... 50%
, (Reading database ... 55%

Ignoring malparsed backtrace: (Reading database ... 20%
, (Reading database ... 25%
, (Reading database ... 30%

Ignoring malparsed backtrace: 2020-08-23T17:13:13.171 INFO:teuthology.orchestra.run.smithi083.stdout:Removing ceph-test (16.0.0-4625-g5661c49e31d-1bionic) ...
, 2020-08-23T17:13:13.492 INFO:teuthology.orchestra.run.smithi094.stdout:Removing ceph-common (16.0.0-4625-g5661c49e31d-1bionic) ...
, 2020-08-23T17:13:13.597 INFO:teuthology.orchestra.run.smithi094.stdout:dpkg: warning: while removing ceph-common, unable to remove directory '/var/lib/ceph': Device or resource busy - directory may be a mount point?

Ignoring malparsed backtrace: 2020-08-23T17:13:18.927 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for ureadahead (0.100.0-21) ...
, 2020-08-23T17:13:18.938 INFO:teuthology.orchestra.run.smithi027.stdout:Purging configuration files for radosgw (16.0.0-4625-g5661c49e31d-1bionic) ...
, 2020-08-23T17:13:19.285 INFO:teuthology.orchestra.run.smithi083.stdout:Processing triggers for systemd (237-3ubuntu10.42) ...

Ignoring malparsed backtrace: (Reading database ... 70%
, (Reading database ... 75%
, (Reading database ... 80%

Ignoring malparsed backtrace: (Reading database ... 90%
, (Reading database ... 95%
, (Reading database ... 100%

Ignoring malparsed backtrace: 2020-08-23T17:13:23.411 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-simplegeneric python3-simplejson python3-singledispatch
, 2020-08-23T17:13:23.412 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita
, 2020-08-23T17:13:23.412 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-tz python3-uritemplate python3-waitress python3-webencodings

Ignoring malparsed backtrace: (Reading database ... 60%
, (Reading database ... 65%
, (Reading database ... 70%

Ignoring malparsed backtrace: 2020-08-23T17:13:25.471 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-markupsafe python3-matplotlib python3-monotonic python3-numpy
, 2020-08-23T17:13:25.471 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-oauth2client python3-olefile python3-paste python3-pastedeploy
, 2020-08-23T17:13:25.471 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-pastescript python3-pecan python3-pil python3-pluggy

Ignoring malparsed backtrace: 2020-08-23T17:13:27.012 INFO:teuthology.orchestra.run.smithi094.stdout:  libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr
, 2020-08-23T17:13:27.013 INFO:teuthology.orchestra.run.smithi094.stdout:  python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest
, 2020-08-23T17:13:27.013 INFO:teuthology.orchestra.run.smithi094.stdout:  python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse

Ignoring malparsed backtrace: 2020-08-23T17:13:28.064 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 1,252 kB disk space will be freed.
, 2020-08-23T17:13:28.165 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... 
, (Reading database ... 5%

Ignoring malparsed backtrace: 2020-08-23T17:13:29.123 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree...
, 2020-08-23T17:13:29.123 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information...
, 2020-08-23T17:13:29.216 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree...

Ignoring malparsed backtrace: 2020-08-23T17:13:29.857 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... 
, (Reading database ... 5%
, (Reading database ... 10%

Ignoring malparsed backtrace: (Reading database ... 90%
, (Reading database ... 95%
, (Reading database ... 100%

Ignoring malparsed backtrace: 2020-08-23T17:13:32.551 INFO:teuthology.orchestra.run.smithi083.stdout:  libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1
, 2020-08-23T17:13:32.551 INFO:teuthology.orchestra.run.smithi083.stdout:  libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0
, 2020-08-23T17:13:32.551 INFO:teuthology.orchestra.run.smithi083.stdout:  libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libjq1

Ignoring malparsed backtrace: 2020-08-23T17:13:33.444 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tz
, 2020-08-23T17:13:33.444 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-uritemplate python3-waitress python3-webencodings python3-webob
, 2020-08-23T17:13:33.445 INFO:teuthology.orchestra.run.smithi027.stdout:  python3-websocket python3-webtest python3-werkzeug socat xmlstarlet

Ignoring malparsed backtrace: (Reading database ... 45%
, (Reading database ... 50%
, (Reading database ... 55%

Ignoring malparsed backtrace: 2020-08-23T17:13:39.948 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy
, 2020-08-23T17:13:39.948 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-simplegeneric python3-simplejson python3-singledispatch
, 2020-08-23T17:13:39.948 INFO:teuthology.orchestra.run.smithi083.stdout:  python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita

Ignoring malparsed backtrace: 2020-08-23T17:13:40.537 INFO:teuthology.orchestra.run.smithi094.stdout:  python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes
, 2020-08-23T17:13:40.537 INFO:teuthology.orchestra.run.smithi094.stdout:  python3-logutils python3-lxml python3-mako python3-markupsafe
, 2020-08-23T17:13:40.537 INFO:teuthology.orchestra.run.smithi094.stdout:  python3-matplotlib python3-monotonic python3-numpy python3-oauth2client

Ignoring malparsed backtrace: (Reading database ... 65%
, (Reading database ... 70%
, (Reading database ... 75%

Ignoring malparsed backtrace: 2020-08-23T17:13:42.488 INFO:teuthology.orchestra.run.smithi027.stdout:  libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1
, 2020-08-23T17:13:42.488 INFO:teuthology.orchestra.run.smithi027.stdout:  libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0
, 2020-08-23T17:13:42.488 INFO:teuthology.orchestra.run.smithi027.stdout:  libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libjq1

Ignoring malparsed backtrace: 2020-08-23T17:13:43.814 INFO:teuthology.orchestra.run.smithi027.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/restful' not empty so not removed
, 2020-08-23T17:13:43.814 INFO:teuthology.orchestra.run.smithi027.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/rbd_support' not empty so not removed
, 2020-08-23T17:13:43.814 INFO:teuthology.orchestra.run.smithi027.stdout:dpkg: warning: while removing ceph-mgr-modules-core, directory '/usr/share/ceph/mgr/prometheus' not empty so not removed

Ignoring malparsed backtrace: 2020-08-23T17:13:55.004 INFO:teuthology.orchestra.run.smithi083.stdout:Removing libsamplerate0:amd64 (0.1.9-1) ...
, 2020-08-23T17:13:55.140 INFO:teuthology.orchestra.run.smithi027.stdout:Removing libopus0:amd64 (1.1.2-1ubuntu1) ...
, 2020-08-23T17:13:55.336 INFO:teuthology.orchestra.run.smithi094.stdout:Removing libshout3:amd64 (2.4.1-2build1) ...

Ignoring malparsed backtrace: 2020-08-23T17:14:09.277 INFO:teuthology.orchestra.run.smithi027.stdout:Removing python-py (1.5.2-1) ...
, 2020-08-23T17:14:09.490 INFO:teuthology.orchestra.run.smithi083.stdout:Removing python3-ceph-argparse (16.0.0-4625-g5661c49e31d-1bionic) ...
, 2020-08-23T17:14:09.598 INFO:teuthology.orchestra.run.smithi094.stdout:Removing python3-ceph-argparse (16.0.0-4625-g5661c49e31d-1bionic) ...

Ignoring malparsed backtrace: 2020-08-23T17:14:26.399 INFO:teuthology.orchestra.run.smithi083.stdout:Removing python3-pyasn1 (0.4.2-3) ...
, 2020-08-23T17:14:26.607 INFO:teuthology.orchestra.run.smithi094.stdout:Removing python3-pyinotify (0.9.6-1) ...
, 2020-08-23T17:14:26.635 INFO:teuthology.orchestra.run.smithi027.stdout:Removing python3-prettytable (0.7.2-3) ...

Ignoring malparsed backtrace: 2020-08-23T17:14:39.852 INFO:teuthology.orchestra.run.smithi083.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
, 2020-08-23T17:14:39.853 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
, 2020-08-23T17:14:40.106 INFO:teuthology.orchestra.run.smithi083.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]

Ignoring malparsed backtrace:     r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run
,     r.wait()

Found 4 distinct failure reasons
Failure: "2020-08-23T16:31:41.708800+0000 mon.b (mon.0) 555 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log
2 jobs: ['5369333', '5369338']
suites intersection: ['clusters/{fixed-3', 'config/none', 'msgr-failures/few', 'openstack}']
suites union: ['clusters/{fixed-3', 'config/none', 'min-compat-client/default', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'pool/ec-data-pool', 'pool/none', 'rbd/librbd/{cache/none', 'rbd/librbd/{cache/writearound', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'workloads/c_api_tests_with_defaults}', 'workloads/c_api_tests}']

Timeout 3h running clone.client.0/qa/workunits/rbd/test_librbd.sh
5 jobs: ['5369417', '5369460', '5369491', '5369364', '5369508']
suites intersection: ['clusters/{fixed-3', 'msgr-failures/few', 'openstack}']
suites union: ['clusters/{fixed-3', 'config/copy-on-read', 'config/permit-partial-discard', 'min-compat-client/default', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/filestore-xfs', 'openstack}', 'pool/ec-data-pool', 'pool/replicated-data-pool', 'pool/small-cache-pool', 'rbd/librbd/{cache/none', 'rbd/librbd/{cache/writearound', 'rbd/librbd/{cache/writeback', 'rbd/librbd/{cache/writethrough', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/c_api_tests_with_defaults}', 'workloads/c_api_tests_with_journaling}', 'workloads/c_api_tests}']

Failure: Command failed (workunit test rbd/test_librbd.sh) on smithi037 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5661c49e31df2517dd62fef514a6210e37e9b4ac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 RBD_FEATURES=125 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh'
3 jobs: ['5369423', '5369513', '5369337']
suites intersection: ['clusters/{fixed-3', 'min-compat-client/default', 'msgr-failures/few', 'openstack}', 'workloads/c_api_tests_with_journaling}']
suites union: ['clusters/{fixed-3', 'config/copy-on-read', 'config/none', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'pool/ec-data-pool', 'pool/replicated-data-pool', 'pool/small-cache-pool', 'rbd/librbd/{cache/writearound', 'rbd/librbd/{cache/writeback', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/c_api_tests_with_journaling}']

Failure: {'Failure object was': {'smithi096.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost-random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"}
1 jobs: ['5369371']
suites: ['clusters/{fixed-3', 'config/permit-partial-discard', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'openstack}', 'pool/none', 'rbd/librbd/{cache/writeback', 'supported-random-distro$/{centos_8}', 'workloads/c_api_tests_with_journaling}']