2022-01-05T13:31:48.539 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-05T13:31:48.541 INFO:teuthology.results:seed: '7184'
2022-01-05T13:32:31.388 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-05T13:32:31.394 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-01-05T13:52:32.949 INFO:teuthology.results:Tests finished! gathering results...
2022-01-05T13:52:33.075 INFO:scrape:Found 1 jobs
2022-01-05T13:52:33.129 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-9882-gf60e0860 (f60e0860726bd9fa65fca7d630ece40c2344eb57) quincy (dev)
,  1: /lib64/libpthread.so.0(+0x12c20) [0x7f199068dc20]
,  2: gsignal()

2022-01-05T13:52:33.131 WARNING:scrape:Ignoring malparsed backtrace: 2022-01-05T13:50:07.487 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2022-01-05T13:49:57.683881+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=49, tm_sec=57, tm_wday=2, tm_yday=5, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=50, tm_sec=4, tm_wday=2, tm_yday=5, tm_isdst=0)
, 2022-01-05T13:50:07.488 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2022-01-05T13:49:57.683881+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=49, tm_sec=57, tm_wday=2, tm_yday=5, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=50, tm_sec=4, tm_wday=2, tm_yday=5, tm_isdst=0)
, 2022-01-05T13:50:07.488 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2022-01-05T13:49:51.154079+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=49, tm_sec=51, tm_wday=2, tm_yday=5, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=50, tm_sec=4, tm_wday=2, tm_yday=5, tm_isdst=0)

2022-01-05T13:52:33.132 WARNING:scrape:Ignoring malparsed backtrace: 2022-01-05T13:50:53.038 INFO:teuthology.orchestra.run.smithi145.stdout:    "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1000' osd_recovery_max_active = '1000' osd_recovery_max_active_hdd = '1000' osd_recovery_max_active_ssd = '1000' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' "
, 2022-01-05T13:50:53.039 INFO:teuthology.orchestra.run.smithi145.stdout:}
, 2022-01-05T13:50:53.049 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd deep-scrub 2

2022-01-05T13:52:33.133 WARNING:scrape:Ignoring malparsed backtrace: 2022-01-05T13:51:16.109 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab
, 2022-01-05T13:51:16.120 INFO:teuthology.task.ansible:Skipping ansible cleanup...
, 2022-01-05T13:51:16.122 DEBUG:teuthology.run_tasks:Unwinding manager selinux

2022-01-05T13:52:33.152 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-9882-gf60e0860 (f60e0860726bd9fa65fca7d630ece40c2344eb57) quincy (dev)
,  1: /lib64/libpthread.so.0(+0x12c20) [0x7f199068dc20]
,  2: gsignal()

2022-01-05T13:52:33.154 WARNING:scrape:Ignoring malparsed backtrace: 2022-01-05T13:50:07.487 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2022-01-05T13:49:57.683881+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=49, tm_sec=57, tm_wday=2, tm_yday=5, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=50, tm_sec=4, tm_wday=2, tm_yday=5, tm_isdst=0)
, 2022-01-05T13:50:07.488 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2022-01-05T13:49:57.683881+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=49, tm_sec=57, tm_wday=2, tm_yday=5, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=50, tm_sec=4, tm_wday=2, tm_yday=5, tm_isdst=0)
, 2022-01-05T13:50:07.488 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2022-01-05T13:49:51.154079+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=49, tm_sec=51, tm_wday=2, tm_yday=5, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=50, tm_sec=4, tm_wday=2, tm_yday=5, tm_isdst=0)

2022-01-05T13:52:33.155 WARNING:scrape:Ignoring malparsed backtrace: 2022-01-05T13:50:53.038 INFO:teuthology.orchestra.run.smithi145.stdout:    "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1000' osd_recovery_max_active = '1000' osd_recovery_max_active_hdd = '1000' osd_recovery_max_active_ssd = '1000' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' "
, 2022-01-05T13:50:53.039 INFO:teuthology.orchestra.run.smithi145.stdout:}
, 2022-01-05T13:50:53.049 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd deep-scrub 2

2022-01-05T13:52:33.155 WARNING:scrape:Ignoring malparsed backtrace: 2022-01-05T13:51:16.109 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab
, 2022-01-05T13:51:16.120 INFO:teuthology.task.ansible:Skipping ansible cleanup...
, 2022-01-05T13:51:16.122 DEBUG:teuthology.run_tasks:Unwinding manager selinux

2022-01-05T13:52:33.177 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-9882-gf60e0860 (f60e0860726bd9fa65fca7d630ece40c2344eb57) quincy (dev)
,  1: /lib64/libpthread.so.0(+0x12c20) [0x7f199068dc20]
,  2: gsignal()

2022-01-05T13:52:33.179 WARNING:scrape:Ignoring malparsed backtrace: 2022-01-05T13:50:07.487 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2022-01-05T13:49:57.683881+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=49, tm_sec=57, tm_wday=2, tm_yday=5, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=50, tm_sec=4, tm_wday=2, tm_yday=5, tm_isdst=0)
, 2022-01-05T13:50:07.488 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2022-01-05T13:49:57.683881+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=49, tm_sec=57, tm_wday=2, tm_yday=5, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=50, tm_sec=4, tm_wday=2, tm_yday=5, tm_isdst=0)
, 2022-01-05T13:50:07.488 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2022-01-05T13:49:51.154079+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=49, tm_sec=51, tm_wday=2, tm_yday=5, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=5, tm_hour=13, tm_min=50, tm_sec=4, tm_wday=2, tm_yday=5, tm_isdst=0)

2022-01-05T13:52:33.180 WARNING:scrape:Ignoring malparsed backtrace: 2022-01-05T13:50:53.038 INFO:teuthology.orchestra.run.smithi145.stdout:    "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1000' osd_recovery_max_active = '1000' osd_recovery_max_active_hdd = '1000' osd_recovery_max_active_ssd = '1000' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' "
, 2022-01-05T13:50:53.039 INFO:teuthology.orchestra.run.smithi145.stdout:}
, 2022-01-05T13:50:53.049 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd deep-scrub 2

2022-01-05T13:52:33.181 WARNING:scrape:Ignoring malparsed backtrace: 2022-01-05T13:51:16.109 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab
, 2022-01-05T13:51:16.120 INFO:teuthology.task.ansible:Skipping ansible cleanup...
, 2022-01-05T13:51:16.122 DEBUG:teuthology.run_tasks:Unwinding manager selinux

2022-01-05T13:52:33.188 INFO:scrape:Found 1 distinct failure reasons
2022-01-05T13:52:33.189 INFO:scrape:Failure: Command failed on smithi145 with status 134: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'echo \'"\'"\'{"type":"native","cluster_name":"cluster2","client_name":"client.migrator","pool_name":"rbd","image_name":"client.0.0","snap_name":"snap"}\'"\'"\' | rbd --cluster cluster1 migration prepare --import-only --source-spec-path - client.0.0\''
2022-01-05T13:52:33.190 INFO:scrape:1 jobs: ['6596348']
2022-01-05T13:52:33.190 INFO:scrape:suites: ['02-cluster/2-node', '03-objectstore/bluestore-bitmap', '04-msgr-failures/few', '05-supported-random-distro$/{centos_8.stream}', '06-clients/migrator', '07-prepare/native', '08-io-workload/qemu_xfstests', '09-migrate-workload/execute', '10-cleanup/cleanup}', 'rbd/migration-external/{01-base/install']
2022-01-05T13:52:33.191 INFO:scrape:
2022-01-05T13:52:33.191 INFO:teuthology.results:Sending results to oro@il.ibm.com: Test Run: oro-2022-01-05_13:30:55-rbd-master-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/oro-2022-01-05_13:30:55-rbd-master-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-05_13:30:55-rbd-master-distro-default-smithi/
failed:  1
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6596348]  rbd/migration-external/{01-base/install 02-cluster/2-node 03-objectstore/bluestore-bitmap 04-msgr-failures/few 05-supported-random-distro$/{centos_8.stream} 06-clients/migrator 07-prepare/native 08-io-workload/qemu_xfstests 09-migrate-workload/execute 10-cleanup/cleanup}
-----------------------------------------------------------------
time:   00:09:32
info:   http://pulpito.ceph.com/oro-2022-01-05_13:30:55-rbd-master-distro-default-smithi/6596348/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-05_13:30:55-rbd-master-distro-default-smithi/6596348/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b2213b47a18b4dd6a3e9225e5a68e9f5

    Command failed on smithi145 with status 134: 'sudo
    TESTDIR=/home/ubuntu/cephtest bash -c \'echo \'"\'"\'{"type":"native","clus
    ter_name":"cluster2","client_name":"client.migrator","pool_name":"rbd","ima
    ge_name":"client.0.0","snap_name":"snap"}\'"\'"\' | rbd --cluster cluster1
    migration prepare --import-only --source-spec-path - client.0.0\''