2020-07-03T07:39:34.986 INFO:root:teuthology version: 1.0.0-5208279 2020-07-03T07:39:34.988 INFO:teuthology.results:subset: '18/9999' 2020-07-03T07:39:34.988 INFO:teuthology.results:seed: '1818' 2020-07-03T11:00:15.221 INFO:root:teuthology version: 1.0.0-5208279 2020-07-03T11:00:15.238 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-03T22:57:36.030 INFO:teuthology.results:Tests finished! gathering results... 2020-07-03T22:57:56.308 INFO:scrape:Found 308 jobs 2020-07-03T22:58:00.120 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-2962-g5ccfc2d5d3 (5ccfc2d5d3a03d700cf9c4a48b194d7836328981) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f44c1569896] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x4f4) [0x5643a3d360c4] 2020-07-03T22:58:00.123 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T09:50:19.250 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T09:50:19.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-07-03T22:58:00.124 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:51:41.449 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T09:51:41.524 INFO:tasks.ceph.osd.5:Stopped , 2020-07-03T09:51:41.525 INFO:teuthology.misc:Shutting down mgr daemons... 2020-07-03T22:58:00.124 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:09.067 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-07-03T22:58:00.125 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:11.237 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-test-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : oniguruma-6.8.2-1.el8.x86_64 3/5 2020-07-03T22:58:00.125 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 4/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 2/4 2020-07-03T22:58:00.126 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_642:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 292 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch2.4.1-12.el8 @epel 454 k 2020-07-03T22:58:00.127 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch0.7-6.el8 @epel 84 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch2.20.0-2.1.el8_1 @CentOS-Base 369 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k 2020-07-03T22:58:00.127 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:21.907 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 27/85 , 2020-07-03T09:53:21.972 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 , 2020-07-03T09:53:22.044 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 28/85 2020-07-03T22:58:00.128 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:29.976 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/85 , 2020-07-03T09:53:29.977 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 , 2020-07-03T09:53:43.748 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 2020-07-03T22:58:00.129 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 44/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 45/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 46/85 2020-07-03T22:58:00.129 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-03T22:58:00.130 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 58/85 2020-07-03T22:58:00.131 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-1.6.1-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-11.0.0-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-03T22:58:00.131 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout: , 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! , 2020-07-03T09:53:53.170 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: ceph-mgr 2020-07-03T22:58:00.132 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout:Removed: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-07-03T22:58:00.132 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 485 k , 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout:Removing dependent packages: , 2020-07-03T09:54:00.150 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 84 k 2020-07-03T22:58:00.133 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 , 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 , 2020-07-03T09:54:02.759 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-07-03T22:58:00.134 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:06.306 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! , 2020-07-03T09:54:06.741 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: rbd-nbd , No packages marked for removal. 2020-07-03T22:58:00.134 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:11.200 INFO:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' , 2020-07-03T09:54:11.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-07-03T09:54:11.232 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2020-07-03T22:58:00.268 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-2962-g5ccfc2d5d3 (5ccfc2d5d3a03d700cf9c4a48b194d7836328981) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f44c1569896] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x4f4) [0x5643a3d360c4] 2020-07-03T22:58:00.271 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T09:50:19.250 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T09:50:19.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-07-03T22:58:00.271 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:51:41.449 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T09:51:41.524 INFO:tasks.ceph.osd.5:Stopped , 2020-07-03T09:51:41.525 INFO:teuthology.misc:Shutting down mgr daemons... 2020-07-03T22:58:00.272 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:09.067 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-07-03T22:58:00.273 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:11.237 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-test-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : oniguruma-6.8.2-1.el8.x86_64 3/5 2020-07-03T22:58:00.273 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 4/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 2/4 2020-07-03T22:58:00.274 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_642:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 292 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch2.4.1-12.el8 @epel 454 k 2020-07-03T22:58:00.275 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch0.7-6.el8 @epel 84 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch2.20.0-2.1.el8_1 @CentOS-Base 369 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k 2020-07-03T22:58:00.275 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:21.907 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 27/85 , 2020-07-03T09:53:21.972 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 , 2020-07-03T09:53:22.044 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 28/85 2020-07-03T22:58:00.276 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:29.976 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/85 , 2020-07-03T09:53:29.977 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 , 2020-07-03T09:53:43.748 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 2020-07-03T22:58:00.277 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 44/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 45/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 46/85 2020-07-03T22:58:00.277 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-03T22:58:00.278 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 58/85 2020-07-03T22:58:00.278 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-1.6.1-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-11.0.0-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-03T22:58:00.279 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout: , 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! , 2020-07-03T09:53:53.170 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: ceph-mgr 2020-07-03T22:58:00.280 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout:Removed: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-07-03T22:58:00.280 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 485 k , 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout:Removing dependent packages: , 2020-07-03T09:54:00.150 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 84 k 2020-07-03T22:58:00.281 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 , 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 , 2020-07-03T09:54:02.759 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-07-03T22:58:00.281 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:06.306 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! , 2020-07-03T09:54:06.741 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: rbd-nbd , No packages marked for removal. 2020-07-03T22:58:00.282 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:11.200 INFO:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' , 2020-07-03T09:54:11.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-07-03T09:54:11.232 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2020-07-03T22:58:00.419 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-2962-g5ccfc2d5d3 (5ccfc2d5d3a03d700cf9c4a48b194d7836328981) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f44c1569896] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x4f4) [0x5643a3d360c4] 2020-07-03T22:58:00.422 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T09:50:19.250 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T09:50:19.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-07-03T22:58:00.423 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:51:41.449 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T09:51:41.524 INFO:tasks.ceph.osd.5:Stopped , 2020-07-03T09:51:41.525 INFO:teuthology.misc:Shutting down mgr daemons... 2020-07-03T22:58:00.423 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:09.067 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-07-03T22:58:00.424 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:11.237 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-test-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : oniguruma-6.8.2-1.el8.x86_64 3/5 2020-07-03T22:58:00.425 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 4/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 2/4 2020-07-03T22:58:00.425 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_642:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 292 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch2.4.1-12.el8 @epel 454 k 2020-07-03T22:58:00.426 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch0.7-6.el8 @epel 84 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch2.20.0-2.1.el8_1 @CentOS-Base 369 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k 2020-07-03T22:58:00.427 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:21.907 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 27/85 , 2020-07-03T09:53:21.972 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 , 2020-07-03T09:53:22.044 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 28/85 2020-07-03T22:58:00.427 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:29.976 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/85 , 2020-07-03T09:53:29.977 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 , 2020-07-03T09:53:43.748 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 2020-07-03T22:58:00.428 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 44/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 45/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 46/85 2020-07-03T22:58:00.429 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-03T22:58:00.429 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 58/85 2020-07-03T22:58:00.430 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-1.6.1-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-11.0.0-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-03T22:58:00.430 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout: , 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! , 2020-07-03T09:53:53.170 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: ceph-mgr 2020-07-03T22:58:00.431 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout:Removed: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-07-03T22:58:00.432 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 485 k , 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout:Removing dependent packages: , 2020-07-03T09:54:00.150 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 84 k 2020-07-03T22:58:00.432 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 , 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 , 2020-07-03T09:54:02.759 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-07-03T22:58:00.433 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:06.306 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! , 2020-07-03T09:54:06.741 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: rbd-nbd , No packages marked for removal. 2020-07-03T22:58:00.433 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:11.200 INFO:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' , 2020-07-03T09:54:11.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-07-03T09:54:11.232 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2020-07-03T22:58:00.572 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-2962-g5ccfc2d5d3 (5ccfc2d5d3a03d700cf9c4a48b194d7836328981) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f44c1569896] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x4f4) [0x5643a3d360c4] 2020-07-03T22:58:00.574 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T09:50:19.250 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T09:50:19.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-07-03T22:58:00.575 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:51:41.449 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T09:51:41.524 INFO:tasks.ceph.osd.5:Stopped , 2020-07-03T09:51:41.525 INFO:teuthology.misc:Shutting down mgr daemons... 2020-07-03T22:58:00.576 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:09.067 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-07-03T22:58:00.576 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:11.237 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-test-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : oniguruma-6.8.2-1.el8.x86_64 3/5 2020-07-03T22:58:00.577 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 4/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 2/4 2020-07-03T22:58:00.578 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_642:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 292 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch2.4.1-12.el8 @epel 454 k 2020-07-03T22:58:00.578 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch0.7-6.el8 @epel 84 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch2.20.0-2.1.el8_1 @CentOS-Base 369 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k 2020-07-03T22:58:00.579 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:21.907 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 27/85 , 2020-07-03T09:53:21.972 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 , 2020-07-03T09:53:22.044 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 28/85 2020-07-03T22:58:00.580 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:29.976 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/85 , 2020-07-03T09:53:29.977 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 , 2020-07-03T09:53:43.748 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 2020-07-03T22:58:00.580 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 44/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 45/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 46/85 2020-07-03T22:58:00.581 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-03T22:58:00.581 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 58/85 2020-07-03T22:58:00.582 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-1.6.1-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-11.0.0-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-03T22:58:00.583 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout: , 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! , 2020-07-03T09:53:53.170 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: ceph-mgr 2020-07-03T22:58:00.583 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout:Removed: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-07-03T22:58:00.584 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 485 k , 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout:Removing dependent packages: , 2020-07-03T09:54:00.150 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 84 k 2020-07-03T22:58:00.584 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 , 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 , 2020-07-03T09:54:02.759 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-07-03T22:58:00.585 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:06.306 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! , 2020-07-03T09:54:06.741 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: rbd-nbd , No packages marked for removal. 2020-07-03T22:58:00.586 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:11.200 INFO:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' , 2020-07-03T09:54:11.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-07-03T09:54:11.232 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2020-07-03T22:58:00.721 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-2962-g5ccfc2d5d3 (5ccfc2d5d3a03d700cf9c4a48b194d7836328981) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f44c1569896] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x4f4) [0x5643a3d360c4] 2020-07-03T22:58:00.724 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T09:50:19.250 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T09:50:19.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-07-03T22:58:00.725 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:51:41.449 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T09:51:41.524 INFO:tasks.ceph.osd.5:Stopped , 2020-07-03T09:51:41.525 INFO:teuthology.misc:Shutting down mgr daemons... 2020-07-03T22:58:00.725 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:09.067 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-07-03T22:58:00.726 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:11.237 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-test-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : oniguruma-6.8.2-1.el8.x86_64 3/5 2020-07-03T22:58:00.727 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 4/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 2/4 2020-07-03T22:58:00.727 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_642:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 292 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch2.4.1-12.el8 @epel 454 k 2020-07-03T22:58:00.728 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch0.7-6.el8 @epel 84 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch2.20.0-2.1.el8_1 @CentOS-Base 369 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k 2020-07-03T22:58:00.729 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:21.907 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 27/85 , 2020-07-03T09:53:21.972 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 , 2020-07-03T09:53:22.044 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 28/85 2020-07-03T22:58:00.730 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:29.976 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/85 , 2020-07-03T09:53:29.977 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 , 2020-07-03T09:53:43.748 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 2020-07-03T22:58:00.730 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 44/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 45/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 46/85 2020-07-03T22:58:00.731 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-03T22:58:00.731 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 58/85 2020-07-03T22:58:00.732 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-1.6.1-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-11.0.0-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-03T22:58:00.733 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout: , 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! , 2020-07-03T09:53:53.170 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: ceph-mgr 2020-07-03T22:58:00.733 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout:Removed: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-07-03T22:58:00.734 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 485 k , 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout:Removing dependent packages: , 2020-07-03T09:54:00.150 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 84 k 2020-07-03T22:58:00.735 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 , 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 , 2020-07-03T09:54:02.759 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-07-03T22:58:00.735 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:06.306 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! , 2020-07-03T09:54:06.741 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: rbd-nbd , No packages marked for removal. 2020-07-03T22:58:00.736 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:11.200 INFO:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' , 2020-07-03T09:54:11.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-07-03T09:54:11.232 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2020-07-03T22:58:00.868 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-2962-g5ccfc2d5d3 (5ccfc2d5d3a03d700cf9c4a48b194d7836328981) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f44c1569896] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x4f4) [0x5643a3d360c4] 2020-07-03T22:58:00.871 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T09:50:19.250 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T09:50:19.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-07-03T22:58:00.872 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:51:41.449 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T09:51:41.524 INFO:tasks.ceph.osd.5:Stopped , 2020-07-03T09:51:41.525 INFO:teuthology.misc:Shutting down mgr daemons... 2020-07-03T22:58:00.873 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:09.067 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-07-03T22:58:00.873 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:11.237 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-test-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : oniguruma-6.8.2-1.el8.x86_64 3/5 2020-07-03T22:58:00.874 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 4/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 2/4 2020-07-03T22:58:00.875 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_642:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 292 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch2.4.1-12.el8 @epel 454 k 2020-07-03T22:58:00.875 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch0.7-6.el8 @epel 84 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch2.20.0-2.1.el8_1 @CentOS-Base 369 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k 2020-07-03T22:58:00.876 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:21.907 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 27/85 , 2020-07-03T09:53:21.972 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 , 2020-07-03T09:53:22.044 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 28/85 2020-07-03T22:58:00.877 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:29.976 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/85 , 2020-07-03T09:53:29.977 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 , 2020-07-03T09:53:43.748 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 2020-07-03T22:58:00.877 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 44/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 45/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 46/85 2020-07-03T22:58:00.878 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-03T22:58:00.878 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 58/85 2020-07-03T22:58:00.879 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-1.6.1-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-11.0.0-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-03T22:58:00.880 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout: , 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! , 2020-07-03T09:53:53.170 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: ceph-mgr 2020-07-03T22:58:00.880 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout:Removed: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-07-03T22:58:00.881 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 485 k , 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout:Removing dependent packages: , 2020-07-03T09:54:00.150 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 84 k 2020-07-03T22:58:00.882 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 , 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 , 2020-07-03T09:54:02.759 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-07-03T22:58:00.882 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:06.306 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! , 2020-07-03T09:54:06.741 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: rbd-nbd , No packages marked for removal. 2020-07-03T22:58:00.883 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:11.200 INFO:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' , 2020-07-03T09:54:11.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-07-03T09:54:11.232 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2020-07-03T22:58:01.018 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-2962-g5ccfc2d5d3 (5ccfc2d5d3a03d700cf9c4a48b194d7836328981) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f44c1569896] , 2: (CopyFromOp::_finish(TestOp::CallbackInfo*)+0x4f4) [0x5643a3d360c4] 2020-07-03T22:58:01.020 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-07-03T09:50:19.250 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json , 2020-07-03T09:50:19.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-07-03T22:58:01.021 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:51:41.449 INFO:teuthology.orchestra.run:waiting for 300 , 2020-07-03T09:51:41.524 INFO:tasks.ceph.osd.5:Stopped , 2020-07-03T09:51:41.525 INFO:teuthology.misc:Shutting down mgr daemons... 2020-07-03T22:58:01.022 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:09.067 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ , 2020-07-03T09:53:09.068 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-07-03T22:58:01.022 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:11.237 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-test-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 , 2020-07-03T09:53:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : oniguruma-6.8.2-1.el8.x86_64 3/5 2020-07-03T22:58:01.023 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:14.378 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 4/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 1/4 , 2020-07-03T09:53:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 2/4 2020-07-03T22:58:01.024 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_642:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 292 k , 2020-07-03T09:53:15.508 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch2.4.1-12.el8 @epel 454 k 2020-07-03T22:58:01.024 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch0.7-6.el8 @epel 84 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch2.20.0-2.1.el8_1 @CentOS-Base 369 k , 2020-07-03T09:53:15.673 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @CentOS-Base 107 k 2020-07-03T22:58:01.025 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:21.907 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 27/85 , 2020-07-03T09:53:21.972 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/85 , 2020-07-03T09:53:22.044 INFO:teuthology.orchestra.run.smithi092.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 28/85 2020-07-03T22:58:01.026 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:29.976 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/85 , 2020-07-03T09:53:29.977 INFO:teuthology.orchestra.run.smithi066.stdout: Erasing : ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 , 2020-07-03T09:53:43.748 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 68/85 2020-07-03T22:58:01.026 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 44/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 45/85 , 2020-07-03T09:53:46.988 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 46/85 2020-07-03T22:58:01.027 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-2.el8_0.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch , 2020-07-03T09:53:48.628 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-03T22:58:01.028 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/85 , 2020-07-03T09:53:49.051 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 58/85 2020-07-03T22:58:01.028 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-1.6.1-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-11.0.0-2.el8.noarch , 2020-07-03T09:53:50.698 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-03T22:58:01.029 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout: , 2020-07-03T09:53:53.021 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! , 2020-07-03T09:53:53.170 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: ceph-mgr 2020-07-03T22:58:01.030 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout:Removed: , 2020-07-03T09:53:56.843 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-07-03T22:58:01.030 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 485 k , 2020-07-03T09:54:00.149 INFO:teuthology.orchestra.run.smithi066.stdout:Removing dependent packages: , 2020-07-03T09:54:00.150 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:16.0.0-2962.g5ccfc2d5d3.el8 @ceph 84 k 2020-07-03T22:58:01.031 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:16.0.0-2962.g5ccfc2d5d3.el8.x86_64 , 2020-07-03T09:54:02.758 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 , 2020-07-03T09:54:02.759 INFO:teuthology.orchestra.run.smithi092.stdout: 2020-07-03T22:58:01.031 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:06.306 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! , 2020-07-03T09:54:06.741 INFO:teuthology.orchestra.run.smithi092.stdout:No match for argument: rbd-nbd , No packages marked for removal. 2020-07-03T22:58:01.032 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-03T09:54:11.200 INFO:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' , 2020-07-03T09:54:11.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-07-03T09:54:11.232 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2020-07-03T22:58:20.718 INFO:scrape:Found 10 distinct failure reasons 2020-07-03T22:58:20.719 INFO:scrape:Failure: Command failed on smithi089 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' 2020-07-03T22:58:20.720 INFO:scrape:82 jobs 2020-07-03T22:58:20.721 INFO:scrape:suites intersection: [] 2020-07-03T22:58:20.721 INFO:scrape:suites union: ['1-install/nautilus', '1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '2-recovery-overrides/{more-async-recovery}', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'backoff/peering', 'bluestore-bitmap', 'ceph', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'd-balancer/on', 'd-thrash/default/{default', 'd-thrash/none', 'debug/mgr', 'fixed-2', 'mode/packaged', 'mode/root', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/with-work/{distro/centos_8.0', 'rados/cephadm/with-work/{distro/centos_latest', 'rados/cephadm/with-work/{distro/rhel_8.0', 'rados/cephadm/with-work/{distro/rhel_latest', 'rados/cephadm/with-work/{distro/ubuntu_18.04', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/objectstore/{backends/alloc-hint', 'rados/objectstore/{backends/fusestore', 'rados/objectstore/{backends/objectcacher-stress', 'rados/rest/{mgr-restful', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/balancer', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/pool-access', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/deduptool', 'rados/singleton/{all/erasure-code-nonregression', 'rados/singleton/{all/mon-auth-caps', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-key-caps', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/radostool', 'rados/singleton/{all/test-crash', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/standalone/{supported-random-distro$/{centos_8}', 'rados/standalone/{supported-random-distro$/{rhel_8}', 'rados/standalone/{supported-random-distro$/{ubuntu_latest}', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rados/verify/{centos_latest', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start', 'start}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'task/test_adoption}', 'task/test_cephadm_repos}', 'task/test_cephadm}', 'tasks/rados_api_tests', 'tasks/rados_api_tests}', 'tasks/rados_cls_all', 'tasks/rados_cls_all}', 'tasks/rados_python}', 'tasks/rados_stress_watch}', 'tasks/rados_workunit_loadgen_big}', 'tasks/rados_workunit_loadgen_mix}', 'tasks/rados_workunit_loadgen_mostlyread}', 'tasks/workunits}', 'thrashers/careful', 'thrashers/force-sync-many', 'thrashers/sync', 'thrashers/sync-many', 'thrashosds-health', 'thrashosds-health}', 'ubuntu_latest}', 'validater/lockdep}', 'validater/valgrind}', 'workloads/crush}', 'workloads/erasure-code}', 'workloads/mgr}', 'workloads/misc}', 'workloads/mon}', 'workloads/osd}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/rados_mon_workunits}', 'workloads/scrub}'] 2020-07-03T22:58:20.722 INFO:scrape: 2020-07-03T22:58:20.722 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean. 2020-07-03T22:58:20.723 INFO:scrape:4 jobs: ['5197110', '5197311', '5197295', '5197116'] 2020-07-03T22:58:20.723 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'openstack}', 'rados'] 2020-07-03T22:58:20.724 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/default/{default', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'tasks/mon_recovery', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'thrashosds-health}', 'validater/valgrind}', 'workloads/admin_socket_objecter_requests}', 'workloads/cache-agent-big}', 'workloads/dedup_tier}'] 2020-07-03T22:58:20.724 INFO:scrape: 2020-07-03T22:58:20.725 INFO:scrape:Failure: wait_for_clean: failed before timeout expired 2020-07-03T22:58:20.725 INFO:scrape:2 jobs: ['5197280', '5197172'] 2020-07-03T22:58:20.725 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'openstack}', 'rados'] 2020-07-03T22:58:20.726 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'd-balancer/crush-compat', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/repair_test}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/redirect}'] 2020-07-03T22:58:20.726 INFO:scrape: 2020-07-03T22:58:20.727 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-07-03T22:58:20.727 INFO:scrape:1 jobs: ['5197224'] 2020-07-03T22:58:20.727 INFO:scrape:suites: ['1-install/luminous', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/on', 'distro$/{centos_7.6}', 'msgr-failures/fastclose', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}'] 2020-07-03T22:58:20.728 INFO:scrape: 2020-07-03T22:58:20.728 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2020-07-03T22:58:20.729 INFO:scrape:1 jobs: ['5197084'] 2020-07-03T22:58:20.729 INFO:scrape:suites: ['msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{centos_8}}'] 2020-07-03T22:58:20.729 INFO:scrape: 2020-07-03T22:58:20.730 INFO:scrape:Timeout 120 running ceph --cluster ceph --log-early quorum_status 2020-07-03T22:58:20.730 INFO:scrape:2 jobs: ['5197227', '5197271'] 2020-07-03T22:58:20.731 INFO:scrape:suites intersection: ['rados'] 2020-07-03T22:58:20.731 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/multimon/{clusters/9', 'rados/verify/{centos_latest', 'supported-random-distro$/{ubuntu_latest}', 'tasks/mon_clock_no_skews}', 'tasks/mon_recovery', 'thrashosds-health}', 'validater/valgrind}'] 2020-07-03T22:58:20.732 INFO:scrape: 2020-07-03T22:58:20.732 INFO:scrape:Failure: Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) 2020-07-03T22:58:20.732 INFO:scrape:4 jobs: ['5197100', '5197023', '5197181', '5197258'] 2020-07-03T22:58:20.733 INFO:scrape:suites intersection: ['task/test_orch_cli}'] 2020-07-03T22:58:20.733 INFO:scrape:suites union: ['rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_orch_cli}'] 2020-07-03T22:58:20.733 INFO:scrape: 2020-07-03T22:58:20.734 INFO:scrape:Dead: b'2020-07-03T22:54:32.361 DEBUG:teuthology.exit:Finished running handlers' 2020-07-03T22:58:20.734 INFO:scrape:1 jobs: ['5197309'] 2020-07-03T22:58:20.735 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/normal', 'msgr-failures/osd-delay', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-small-objects}'] 2020-07-03T22:58:20.735 INFO:scrape: 2020-07-03T22:58:20.735 INFO:scrape:Failure: ceph version 14.2.10-14.g120f482 was not installed, found 14.2.10-10.g8bfdf6e.el7. 2020-07-03T22:58:20.736 INFO:scrape:1 jobs: ['5197321'] 2020-07-03T22:58:20.737 INFO:scrape:suites: ['1-install/nautilus-v1only', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{centos_7.6}', 'msgr-failures/fastclose', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}'] 2020-07-03T22:58:20.737 INFO:scrape: 2020-07-03T22:58:20.738 INFO:scrape:Failure: "2020-07-03T07:56:25.036483+0000 mon.b (mon.1) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log 2020-07-03T22:58:20.738 INFO:scrape:1 jobs: ['5197021'] 2020-07-03T22:58:20.738 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'msgr-failures/osd-delay', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}'] 2020-07-03T22:58:20.739 INFO:scrape: 2020-07-03T22:58:20.752 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/ failed: 98 dead: 1 running: 0 waiting: 0 queued: 0 passed: 209 Fail ================================================================= [5197021] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:26:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197021/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197021/ "2020-07-03T07:56:25.036483+0000 mon.b (mon.1) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log [5197023] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} ----------------------------------------------------------------- time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197023/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197023/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=44f3cec0b32b489a837d0966eb013110 Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5197028] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:19:07 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197028/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197028/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7d134aee0551424d90fe45a54d493f34 Command failed on smithi078 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197029] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197029/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197029/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d8f7731a2efe4366a35662e0f20e99d7 Command failed on smithi157 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197031] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197031/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197031/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=50c8d41f0c8f4904bf66d1e75f70098e Command failed on smithi155 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197032] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:43 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197032/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197032/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1ef1023459fa4c37a63d4ef6168b9a41 Command failed on smithi183 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.a && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.a && cd /home/ubuntu/cephtest/clone.client.a && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197034] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} ----------------------------------------------------------------- time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197034/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197034/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3a34a1d81cab4c3fa5ea224e9dc3f4c7 Command failed on smithi097 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197035] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 03:25:42 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197035/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197035/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=be739717f42c4d6f83d19a6dc37b3a80 Command failed on smithi072 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197044] rados/singleton/{all/test-crash msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197044/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197044/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=af169484ff2e489bac496758afc38668 Command failed on smithi023 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197047] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:27:32 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197047/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197047/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2c115e884021440a8d9240b026dbbcd6 Command failed on smithi163 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197051] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:08 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197051/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197051/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=10965f0ac01b434582d9b5c733c5f65a Command failed on smithi191 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197052] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197052/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197052/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4611d2473ed14fff80615c564137058c Command failed on smithi125 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197054] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:31:20 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197054/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197054/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bd62f59d58a6416abc07453028ed573d Command failed on smithi131 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197057] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} ----------------------------------------------------------------- time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197057/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197057/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=52a5ffe86ee04cb29bff9ee6ae813d6c Command failed on smithi062 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197062] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:24:11 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197062/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197062/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c065688b806e49e69bd0ec7117e2a065 Command failed on smithi027 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197066] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} ----------------------------------------------------------------- time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197066/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197066/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5f0973ef7f894cd5be130da90b01ee19 Command failed on smithi116 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197077] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:12:25 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197077/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197077/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4ad14a1ec7554fac8c6512ac269cd4f5 Command failed on smithi094 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197078] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} ----------------------------------------------------------------- time: 00:14:13 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197078/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197078/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=26798888cccf4f73ab01288bee7ec7bb Command failed on smithi136 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197079] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197079/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197079/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=49f0168b2acf4f0788af9fedc74415a6 Command failed on smithi137 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197081] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197081/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197081/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=30cf474d727c41f788881c4fba03732e Command failed on smithi047 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197082] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:23:36 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197082/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197082/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b71d4029be9f4c3c8a26b1c1de4fcd47 Command failed on smithi022 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197084] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197084/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197084/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5197085] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197085/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197085/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=45885111cae1482c990efc2513a5e668 Command failed on smithi191 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197087] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197087/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197087/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a99b5580c05c410280ba9b451d086057 Command failed on smithi028 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197098] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:14:39 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197098/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197098/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f87826b0e6684bba9de88df0d34938d8 Command failed on smithi157 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197099] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197099/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197099/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f1433101aabb48a98bdb6003693a3b85 Command failed on smithi105 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197100] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197100/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197100/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5aa6b84f4e50447cae85dbdd5f18e331 Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5197104] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_python} ----------------------------------------------------------------- time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197104/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197104/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a23987ed420b4b6a9fdbea0ba1068493 Command failed on smithi026 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197105] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197105/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197105/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bb0d707657844d039010c9fa1eec2db6 Command failed on smithi045 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197106] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:21:50 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197106/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197106/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a354551ff893405892a8fe36333fd1d4 Command failed on smithi027 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197110] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:57:28 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197110/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197110/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4d36c751f4cc43b6a9aeb9942841769b Scrubbing terminated -- not all pgs were active and clean. [5197113] rados/singleton/{all/deduptool msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:16:00 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197113/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197113/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3c1948de6dd34b72838e500b860412f5 Command failed on smithi036 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197116] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/dedup_tier} ----------------------------------------------------------------- time: 00:45:08 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197116/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197116/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6acbdefe283a40d2a123dd8461912ac3 Scrubbing terminated -- not all pgs were active and clean. [5197119] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} ----------------------------------------------------------------- time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197119/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197119/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f0931649c7d0467a927d8b658b45ee78 Command failed on smithi116 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197121] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} ----------------------------------------------------------------- time: 00:14:23 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197121/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197121/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b0d37654859849ccb6b38c9425efb455 Command failed on smithi083 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197125] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:22:06 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197125/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197125/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2d9c912c47574909989546cfa6661566 Command failed on smithi194 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197128] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} ----------------------------------------------------------------- time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197128/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197128/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4fc38163e27d4519b44f1a5489013949 Command failed on smithi173 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197131] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:18:40 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197131/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197131/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e1ac2e7d1e3a4b17a35ec655f77b5ac1 Command failed on smithi047 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197139] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197139/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197139/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=21ecd9888eca4746ba52e679180cbafb Command failed on smithi089 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197142] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197142/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197142/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0de03ad14cd943aea97176ea4b66eb00 Command failed on smithi038 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197143] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} ----------------------------------------------------------------- time: 00:11:04 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197143/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197143/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=45cc1704cdc04a5aa10d687b412582ea Command failed on smithi043 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197145] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197145/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197145/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=74f02eb46f62452682fcbb659459da1f Command failed on smithi151 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197155] rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197155/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197155/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2cb99c0253bd4798b62d869e6a936f3e Command failed on smithi191 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197158] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197158/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197158/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fee7614b50d14bab8b2303290186cc97 Command failed on smithi044 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197159] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197159/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197159/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=62e63863c0e44b2dbce9c3b93f7fa7ea Command failed on smithi095 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197161] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:19:03 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197161/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197161/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bd10052c263f4605afd4ea5ae8fe4277 Command failed on smithi079 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197164] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} ----------------------------------------------------------------- time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197164/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197164/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1989ffbe74a046a4a04ec08e07ebea3a Command failed on smithi168 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197165] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:19:16 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197165/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197165/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=08e055da0be34cdd833ea034f6108774 Command failed on smithi019 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197167] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 00:31:15 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197167/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197167/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b7fcc55d87f34e649cf337bf8c316953 Command failed on smithi036 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197168] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197168/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197168/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b43c9bc6943c40429dcb5aa88ff8834b Command failed on smithi103 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197172] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect} ----------------------------------------------------------------- time: 00:29:57 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197172/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197172/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1f1b0c6ab9fb4fe5a47b04ffcd2a3b64 wait_for_clean: failed before timeout expired [5197178] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197178/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197178/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d281ae266ec8456fa6d0dc5ba5ea9288 Command failed on smithi123 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197180] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} ----------------------------------------------------------------- time: 00:16:20 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197180/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197180/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f7ce2a088adc41c8aba2c0080df03c0c Command failed on smithi188 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197181] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} ----------------------------------------------------------------- time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197181/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197181/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e1e139f0ce65456496742f6b53afbaa8 Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5197185] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197185/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197185/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ebb4bf2a9702443e920cf712f06c0f1a Command failed on smithi076 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197202] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197202/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197202/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1736e555c1ee49bcb771488a99c5ce1e Command failed on smithi031 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197204] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} ----------------------------------------------------------------- time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197204/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197204/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=69b4aa451fc9424a8031156d2a3b7257 Command failed on smithi151 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197206] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/workunits} ----------------------------------------------------------------- time: 00:16:02 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197206/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197206/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5f2809a08c5d466cbe7f1f59224780d8 Command failed on smithi059 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197208] rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197208/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197208/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=29e98ffa2af1407483c997f1839f6d4e Command failed on smithi195 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197209] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} ----------------------------------------------------------------- time: 00:10:35 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197209/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197209/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d26045ec225d4fccb10483820f144f68 Command failed on smithi050 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197210] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} ----------------------------------------------------------------- time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197210/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197210/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5bd0427ad02d4176a9a01386c458d056 Command failed on smithi131 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197213] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:16:22 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197213/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197213/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=aedd243ccb9d4ab48a085f7a487e29fc Command failed on smithi134 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197214] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:23:01 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197214/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197214/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=933d86a95daf42ebbd6faad2e22ae8e4 Command failed on smithi197 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197215] rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197215/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197215/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=27974c11bd9c40afbb3877dbbcc5941e Command failed on smithi044 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197217] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} ----------------------------------------------------------------- time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197217/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197217/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b12e36fe3c724d59b552f9430ea81568 Command failed on smithi081 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197224] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:24:06 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197224/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197224/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2d984e7784b6421cbb79d897f080edc1 reached maximum tries (180) after waiting for 180 seconds [5197225] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197225/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197225/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b1daff3308494913960e095df60df30b Command failed on smithi045 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197227] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:28:31 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197227/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197227/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9c6c25422b0d4509aa3ceb70d74e726d Command failed on smithi043 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status' [5197229] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} ----------------------------------------------------------------- time: 00:16:59 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197229/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197229/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8fa0787619b94dcf9bba52f2f3bbc571 Command failed on smithi123 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197231] rados/singleton/{all/mon-config msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197231/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197231/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=43977ebd3ee24de9bb7e0743d39a6d02 Command failed on smithi181 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197232] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:21:49 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197232/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197232/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f40b8d94f7cb4642876dd2f90a445bcb Command failed on smithi006 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197236] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:50 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197236/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197236/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f02abbdbd4184af1b19faecc1ab50fe6 Command failed on smithi165 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197241] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:58 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197241/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197241/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b6f80376be2241a1b0fef26ffe0c5955 Command failed on smithi005 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197251] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} ----------------------------------------------------------------- time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197251/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197251/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6266f9dda44748e99409563eaead14e0 Command failed on smithi002 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197253] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:22:55 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197253/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197253/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9f61952957a54f5ba062e85c6b1b0502 Command failed on smithi040 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197258] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197258/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197258/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d73c842705e44fea8fe00c6d0e76db8f Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5197260] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197260/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197260/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8bf8fce8370d4f27b42962de558614aa Command failed on smithi104 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197271] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197271/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197271/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9d2c68fc333047cf827f1bd4ea2dd114 Command failed on smithi193 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early quorum_status' [5197273] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:16:13 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197273/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197273/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d1422af952874c91aba8826e00f82cba Command failed on smithi005 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197274] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:18:51 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197274/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197274/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1e19c936f6c2483fa8ca2d16c7c3b17b Command failed on smithi085 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197276] rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197276/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197276/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c64e8f0d94464326aada0c351b6f4d9d Command failed on smithi172 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197279] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} ----------------------------------------------------------------- time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197279/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197279/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=edb363967a6e46828d042e2b53daa2d4 Command failed on smithi144 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197280] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} ----------------------------------------------------------------- time: 00:27:41 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197280/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197280/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f64bd5269d5b4a2ba6c36b567d5bf15c wait_for_clean: failed before timeout expired [5197282] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197282/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197282/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5712fb70256643c6bf54726928b23b25 Command failed on smithi031 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197284] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197284/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197284/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=67738e4a655d4ad98b1cf031373b050e Command failed on smithi003 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197289] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 00:27:01 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197289/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197289/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=171114e733c84d7e8265387e51b4aacb Command failed on smithi125 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197291] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} ----------------------------------------------------------------- time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197291/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197291/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ec9a9a081b2941b39fd78179e466c016 Command failed on smithi157 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197292] rados/singleton/{all/radostool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197292/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197292/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6e135f97995f4128ab2af4bdcd5fa9ad Command failed on smithi135 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197294] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} ----------------------------------------------------------------- time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197294/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197294/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d901f9c341c045139a888dd74bcf3b51 Command failed on smithi049 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197295] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} ----------------------------------------------------------------- time: 00:41:33 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197295/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197295/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5c9c24d028eb430da5b7dc66b29d9a03 Scrubbing terminated -- not all pgs were active and clean. [5197296] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197296/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197296/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fbeb598062ba4e62acf9afd04ae9fbdc Command failed on smithi038 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197304] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:57 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197304/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197304/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9b128375c72e4301a41684b052983e98 Command failed on smithi171 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197311] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-big} ----------------------------------------------------------------- time: 00:45:13 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197311/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197311/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1e6e127c0e39404da8a44c3b1d4be11c Scrubbing terminated -- not all pgs were active and clean. [5197313] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197313/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197313/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=747f0852fb9a4601b1f852a699564c86 Command failed on smithi044 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197314] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:13:58 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197314/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197314/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e81bafae30e2434fbbf50a2ef80720f3 Command failed on smithi161 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197315] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197315/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197315/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1f14ecd7e8ae486d9d43d7be2a795bbc Command failed on smithi152 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197321] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197321/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197321/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a6d6d746eb3d45868b0629da78bc4d64 ceph version 14.2.10-14.g120f482 was not installed, found 14.2.10-10.g8bfdf6e.el7. [5197322] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197322/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197322/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=20d57984c5ab4c1a924df687deca2d7b Command failed on smithi078 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' Dead ================================================================= [5197309] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197309/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197309/ Pass ================================================================= [5197018] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197018/ [5197019] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197019/ [5197020] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197020/ [5197022] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:19:11 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197022/ [5197024] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197024/ [5197025] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197025/ [5197026] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 02:01:50 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197026/ [5197027] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197027/ [5197030] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:39 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197030/ [5197033] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{ubuntu_latest}} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197033/ [5197036] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197036/ [5197037] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:28:07 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197037/ [5197038] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:24:28 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197038/ [5197039] rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197039/ [5197040] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197040/ [5197041] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/many workloads/pool-create-delete} time: 00:20:00 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197041/ [5197042] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197042/ [5197043] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197043/ [5197045] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:39:24 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197045/ [5197046] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:12 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197046/ [5197048] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197048/ [5197049] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197049/ [5197050] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197050/ [5197053] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{rhel_8.0} fixed-2} time: 00:18:28 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197053/ [5197055] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197055/ [5197056] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:34 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197056/ [5197058] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197058/ [5197059] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:23:55 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197059/ [5197060] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 01:24:04 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197060/ [5197061] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/failover} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197061/ [5197063] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:23:04 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197063/ [5197064] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects} time: 00:25:06 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197064/ [5197065] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:32 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197065/ [5197067] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} time: 01:02:52 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197067/ [5197068] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197068/ [5197069] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:38:54 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197069/ [5197070] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{centos_8}} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197070/ [5197071] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197071/ [5197072] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197072/ [5197073] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197073/ [5197074] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:24:17 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197074/ [5197075] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197075/ [5197076] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197076/ [5197080] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:16 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197080/ [5197083] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:33 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197083/ [5197086] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197086/ [5197088] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:11:02 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197088/ [5197089] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197089/ [5197090] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197090/ [5197091] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197091/ [5197092] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:41 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197092/ [5197093] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:49 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197093/ [5197094] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197094/ [5197095] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:34:07 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197095/ [5197096] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197096/ [5197097] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197097/ [5197101] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 01:01:12 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197101/ [5197102] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197102/ [5197103] rados/singleton/{all/admin-socket msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197103/ [5197107] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:49 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197107/ [5197108] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197108/ [5197109] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197109/ [5197111] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:19:08 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197111/ [5197112] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197112/ [5197114] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197114/ [5197115] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197115/ [5197117] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:31:57 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197117/ [5197118] rados/multimon/{clusters/6 msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197118/ [5197120] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197120/ [5197122] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197122/ [5197123] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_8}} time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197123/ [5197124] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:24:05 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197124/ [5197126] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197126/ [5197127] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:39:22 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197127/ [5197129] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197129/ [5197130] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197130/ [5197132] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:21 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197132/ [5197133] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197133/ [5197134] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197134/ [5197135] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:34 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197135/ [5197136] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:29:49 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197136/ [5197137] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197137/ [5197138] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197138/ [5197140] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:13:33 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197140/ [5197141] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197141/ [5197144] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{centos_8}} time: 00:08:28 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197144/ [5197146] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:43 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197146/ [5197147] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:34:38 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197147/ [5197148] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/progress} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197148/ [5197149] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197149/ [5197150] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:40:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197150/ [5197151] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197151/ [5197152] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197152/ [5197153] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197153/ [5197154] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:31:51 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197154/ [5197156] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:16:59 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197156/ [5197157] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:32:46 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197157/ [5197160] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:45:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197160/ [5197162] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197162/ [5197163] rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:31:11 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197163/ [5197166] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:06 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197166/ [5197169] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:10 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197169/ [5197170] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:30:50 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197170/ [5197171] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197171/ [5197173] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197173/ [5197174] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:35:26 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197174/ [5197175] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197175/ [5197176] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:15 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197176/ [5197177] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:11 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197177/ [5197179] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/prometheus} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197179/ [5197182] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197182/ [5197183] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197183/ [5197184] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197184/ [5197186] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} time: 01:17:49 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197186/ [5197187] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197187/ [5197188] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197188/ [5197189] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197189/ [5197190] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/many workloads/snaps-few-objects} time: 00:35:25 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197190/ [5197191] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:16:29 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197191/ [5197192] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197192/ [5197193] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:56:08 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197193/ [5197194] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197194/ [5197195] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{centos_8}} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197195/ [5197196] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197196/ [5197197] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/lockdep} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197197/ [5197198] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197198/ [5197199] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197199/ [5197200] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/set-chunk-promote-flush} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197200/ [5197201] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:02:26 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197201/ [5197203] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_18.04_podman} fixed-2} time: 00:20:48 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197203/ [5197205] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197205/ [5197207] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:48 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197207/ [5197211] rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:13 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197211/ [5197212] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197212/ [5197216] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} time: 00:23:12 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197216/ [5197218] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:35 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197218/ [5197219] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:56 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197219/ [5197220] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197220/ [5197221] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/pool-create-delete} time: 00:19:15 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197221/ [5197222] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:21:48 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197222/ [5197223] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197223/ [5197226] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:20 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197226/ [5197228] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197228/ [5197230] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{ubuntu_latest}} time: 00:16:37 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197230/ [5197233] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:27:47 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197233/ [5197234] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/crash} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197234/ [5197235] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:32 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197235/ [5197237] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:19 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197237/ [5197238] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:01:53 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197238/ [5197239] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:12:37 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197239/ [5197240] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:19:22 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197240/ [5197242] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197242/ [5197243] rados/singleton/{all/osd-backfill msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197243/ [5197244] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197244/ [5197245] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} time: 00:19:02 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197245/ [5197246] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197246/ [5197247] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197247/ [5197248] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197248/ [5197249] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_8}} time: 00:22:23 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197249/ [5197250] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:21:01 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197250/ [5197252] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_5925} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197252/ [5197254] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197254/ [5197255] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197255/ [5197256] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:34:37 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197256/ [5197257] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:41:01 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197257/ [5197259] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197259/ [5197261] rados/singleton/{all/osd-recovery msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197261/ [5197262] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:40 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197262/ [5197263] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197263/ [5197264] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/failover} time: 00:16:06 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197264/ [5197265] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:09 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197265/ [5197266] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:18 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197266/ [5197267] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{rhel_8}} time: 00:21:47 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197267/ [5197268] rados/singleton/{all/peer msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:45 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197268/ [5197269] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197269/ [5197270] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197270/ [5197272] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:01:32 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197272/ [5197275] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:32:36 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197275/ [5197277] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:41 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197277/ [5197278] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197278/ [5197281] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197281/ [5197283] rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:07:49 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197283/ [5197285] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197285/ [5197286] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:28 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197286/ [5197287] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197287/ [5197288] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:33 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197288/ [5197290] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197290/ [5197293] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/insights} time: 00:15:56 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197293/ [5197297] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197297/ [5197298] rados/multimon/{clusters/21 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197298/ [5197299] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197299/ [5197300] rados/singleton/{all/random-eio msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:24:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197300/ [5197301] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197301/ [5197302] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_8}} time: 00:31:37 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197302/ [5197303] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197303/ [5197305] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:32:33 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197305/ [5197306] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197306/ [5197307] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:42 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197307/ [5197308] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 04:33:32 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197308/ [5197310] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197310/ [5197312] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197312/ [5197316] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:15:37 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197316/ [5197317] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:04 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197317/ [5197318] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/lockdep} time: 00:12:00 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197318/ [5197319] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197319/ [5197320] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:17:27 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197320/ [5197323] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197323/ [5197324] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:26:56 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197324/ [5197325] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:07 info: http://pulpito.ceph.com/teuthology-2020-07-03_07:01:02-rados-master-distro-basic-smithi/5197325/