2021-07-27T13:25:12.166 INFO:root:teuthology version: 1.1.0-73aa7e3b 2021-07-27T13:25:12.168 INFO:teuthology.results:subset: '100/100000' 2021-07-27T13:25:12.168 INFO:teuthology.results:seed: '8270' 2021-07-27T23:23:03.780 INFO:root:teuthology version: 1.1.0-73aa7e3b 2021-07-27T23:23:03.826 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-07-28T11:21:05.835 INFO:teuthology.results:Tests finished! gathering results... 2021-07-28T11:21:48.166 INFO:scrape:Found 360 jobs 2021-07-28T11:21:49.611 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fe579e34b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x55815227d191] 2021-07-28T11:21:49.612 WARNING:scrape:Ignoring malparsed backtrace: Read #1:22300612:::benchmark_data_smithi172_446075_object166:head# , Read #1:2286461b:::benchmark_data_smithi172_446075_object51:head# , Read #1:22c8753f:::benchmark_data_smithi172_452300_object90:head# 2021-07-28T11:21:49.612 WARNING:scrape:Ignoring malparsed backtrace: Read #1:522ca259:::benchmark_data_smithi172_446075_object403:head# , Read #1:5233355e:::benchmark_data_smithi172_452300_object38:head# , Read #1:524e7399:::benchmark_data_smithi172_446075_object71:head# 2021-07-28T11:21:49.613 WARNING:scrape:Ignoring malparsed backtrace: Read #1:83885c48:::benchmark_data_smithi172_446075_object209:head# , Read #1:83a36c03:::benchmark_data_smithi172_446075_object335:head# , Read #1:83a59deb:::benchmark_data_smithi172_446075_object320:head# 2021-07-28T11:21:49.614 WARNING:scrape:Ignoring malparsed backtrace: Read #1:b85212b4:::benchmark_data_smithi172_446075_object169:head# , Read #1:b852f0c6:::benchmark_data_smithi172_446075_object231:head# , Read #1:b8615e71:::benchmark_last_metadata:head# 2021-07-28T11:21:49.614 WARNING:scrape:Ignoring malparsed backtrace: Read #1:eb8808f8:::benchmark_data_smithi172_446075_object41:head# , Read #1:eba2d310:::benchmark_data_smithi172_446075_object114:head# , Read #1:ebaeb98a:::benchmark_data_smithi172_446075_object124:head# 2021-07-28T11:21:49.615 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:37.847 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:89916d32:::benchmark_data_smithi172_446075_object99:head# , 2021-07-28T00:41:37.847 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:37.856 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:89edc045:::benchmark_data_smithi172_446075_object0:head# 2021-07-28T11:21:49.616 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:39.104 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:39.137 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:a88b3d5b:::benchmark_data_smithi172_446075_object164:head# , 2021-07-28T00:41:39.138 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.616 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:40.977 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:cfbc1e45:::benchmark_data_smithi172_446075_object336:head# , 2021-07-28T00:41:40.978 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:41.011 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:d0335db6:::benchmark_data_smithi172_446075_object281:head# 2021-07-28T11:21:49.617 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:42.752 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:42.777 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:ebffbb87:::benchmark_data_smithi172_446075_object12:head# , 2021-07-28T00:41:42.777 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.617 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:46.105 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:46.129 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:0450e97b:::benchmark_data_smithi172_446075_object121:head# , 2021-07-28T00:41:46.129 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.618 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:47.929 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:20489435:::benchmark_data_smithi172_446075_object230:head# , 2021-07-28T00:41:47.929 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:47.954 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:205459db:::benchmark_data_smithi172_446075_object117:head# 2021-07-28T11:21:49.619 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:49.981 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:50.014 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:40ac5710:::benchmark_data_smithi172_446075_object360:head# , 2021-07-28T00:41:50.015 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.619 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:51.780 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:5de4dc63:::benchmark_data_smithi172_446075_object333:head# , 2021-07-28T00:41:51.780 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:51.805 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:5e546dc4:::benchmark_data_smithi172_446075_object40:head# 2021-07-28T11:21:49.620 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fecd0039b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x55b9ff7fd191] 2021-07-28T11:21:49.620 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/remote.py", line 509, in run , r = self._runner(client=self.ssh, name=self.shortname, **kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/run.py", line 455, in run 2021-07-28T11:21:49.745 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fe579e34b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x55815227d191] 2021-07-28T11:21:49.746 WARNING:scrape:Ignoring malparsed backtrace: Read #1:22300612:::benchmark_data_smithi172_446075_object166:head# , Read #1:2286461b:::benchmark_data_smithi172_446075_object51:head# , Read #1:22c8753f:::benchmark_data_smithi172_452300_object90:head# 2021-07-28T11:21:49.746 WARNING:scrape:Ignoring malparsed backtrace: Read #1:522ca259:::benchmark_data_smithi172_446075_object403:head# , Read #1:5233355e:::benchmark_data_smithi172_452300_object38:head# , Read #1:524e7399:::benchmark_data_smithi172_446075_object71:head# 2021-07-28T11:21:49.747 WARNING:scrape:Ignoring malparsed backtrace: Read #1:83885c48:::benchmark_data_smithi172_446075_object209:head# , Read #1:83a36c03:::benchmark_data_smithi172_446075_object335:head# , Read #1:83a59deb:::benchmark_data_smithi172_446075_object320:head# 2021-07-28T11:21:49.748 WARNING:scrape:Ignoring malparsed backtrace: Read #1:b85212b4:::benchmark_data_smithi172_446075_object169:head# , Read #1:b852f0c6:::benchmark_data_smithi172_446075_object231:head# , Read #1:b8615e71:::benchmark_last_metadata:head# 2021-07-28T11:21:49.748 WARNING:scrape:Ignoring malparsed backtrace: Read #1:eb8808f8:::benchmark_data_smithi172_446075_object41:head# , Read #1:eba2d310:::benchmark_data_smithi172_446075_object114:head# , Read #1:ebaeb98a:::benchmark_data_smithi172_446075_object124:head# 2021-07-28T11:21:49.749 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:37.847 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:89916d32:::benchmark_data_smithi172_446075_object99:head# , 2021-07-28T00:41:37.847 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:37.856 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:89edc045:::benchmark_data_smithi172_446075_object0:head# 2021-07-28T11:21:49.750 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:39.104 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:39.137 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:a88b3d5b:::benchmark_data_smithi172_446075_object164:head# , 2021-07-28T00:41:39.138 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.750 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:40.977 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:cfbc1e45:::benchmark_data_smithi172_446075_object336:head# , 2021-07-28T00:41:40.978 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:41.011 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:d0335db6:::benchmark_data_smithi172_446075_object281:head# 2021-07-28T11:21:49.751 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:42.752 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:42.777 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:ebffbb87:::benchmark_data_smithi172_446075_object12:head# , 2021-07-28T00:41:42.777 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.752 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:46.105 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:46.129 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:0450e97b:::benchmark_data_smithi172_446075_object121:head# , 2021-07-28T00:41:46.129 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.753 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:47.929 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:20489435:::benchmark_data_smithi172_446075_object230:head# , 2021-07-28T00:41:47.929 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:47.954 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:205459db:::benchmark_data_smithi172_446075_object117:head# 2021-07-28T11:21:49.753 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:49.981 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:50.014 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:40ac5710:::benchmark_data_smithi172_446075_object360:head# , 2021-07-28T00:41:50.015 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.754 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:51.780 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:5de4dc63:::benchmark_data_smithi172_446075_object333:head# , 2021-07-28T00:41:51.780 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:51.805 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:5e546dc4:::benchmark_data_smithi172_446075_object40:head# 2021-07-28T11:21:49.755 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fecd0039b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x55b9ff7fd191] 2021-07-28T11:21:49.755 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/remote.py", line 509, in run , r = self._runner(client=self.ssh, name=self.shortname, **kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/run.py", line 455, in run 2021-07-28T11:21:49.867 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fe579e34b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x55815227d191] 2021-07-28T11:21:49.868 WARNING:scrape:Ignoring malparsed backtrace: Read #1:22300612:::benchmark_data_smithi172_446075_object166:head# , Read #1:2286461b:::benchmark_data_smithi172_446075_object51:head# , Read #1:22c8753f:::benchmark_data_smithi172_452300_object90:head# 2021-07-28T11:21:49.869 WARNING:scrape:Ignoring malparsed backtrace: Read #1:522ca259:::benchmark_data_smithi172_446075_object403:head# , Read #1:5233355e:::benchmark_data_smithi172_452300_object38:head# , Read #1:524e7399:::benchmark_data_smithi172_446075_object71:head# 2021-07-28T11:21:49.870 WARNING:scrape:Ignoring malparsed backtrace: Read #1:83885c48:::benchmark_data_smithi172_446075_object209:head# , Read #1:83a36c03:::benchmark_data_smithi172_446075_object335:head# , Read #1:83a59deb:::benchmark_data_smithi172_446075_object320:head# 2021-07-28T11:21:49.870 WARNING:scrape:Ignoring malparsed backtrace: Read #1:b85212b4:::benchmark_data_smithi172_446075_object169:head# , Read #1:b852f0c6:::benchmark_data_smithi172_446075_object231:head# , Read #1:b8615e71:::benchmark_last_metadata:head# 2021-07-28T11:21:49.871 WARNING:scrape:Ignoring malparsed backtrace: Read #1:eb8808f8:::benchmark_data_smithi172_446075_object41:head# , Read #1:eba2d310:::benchmark_data_smithi172_446075_object114:head# , Read #1:ebaeb98a:::benchmark_data_smithi172_446075_object124:head# 2021-07-28T11:21:49.871 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:37.847 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:89916d32:::benchmark_data_smithi172_446075_object99:head# , 2021-07-28T00:41:37.847 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:37.856 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:89edc045:::benchmark_data_smithi172_446075_object0:head# 2021-07-28T11:21:49.872 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:39.104 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:39.137 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:a88b3d5b:::benchmark_data_smithi172_446075_object164:head# , 2021-07-28T00:41:39.138 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.873 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:40.977 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:cfbc1e45:::benchmark_data_smithi172_446075_object336:head# , 2021-07-28T00:41:40.978 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:41.011 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:d0335db6:::benchmark_data_smithi172_446075_object281:head# 2021-07-28T11:21:49.874 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:42.752 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:42.777 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:ebffbb87:::benchmark_data_smithi172_446075_object12:head# , 2021-07-28T00:41:42.777 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.874 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:46.105 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:46.129 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:0450e97b:::benchmark_data_smithi172_446075_object121:head# , 2021-07-28T00:41:46.129 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.875 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:47.929 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:20489435:::benchmark_data_smithi172_446075_object230:head# , 2021-07-28T00:41:47.929 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:47.954 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:205459db:::benchmark_data_smithi172_446075_object117:head# 2021-07-28T11:21:49.875 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:49.981 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:50.014 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:40ac5710:::benchmark_data_smithi172_446075_object360:head# , 2021-07-28T00:41:50.015 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:49.876 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:51.780 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:5de4dc63:::benchmark_data_smithi172_446075_object333:head# , 2021-07-28T00:41:51.780 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:51.805 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:5e546dc4:::benchmark_data_smithi172_446075_object40:head# 2021-07-28T11:21:49.877 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fecd0039b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x55b9ff7fd191] 2021-07-28T11:21:49.877 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/remote.py", line 509, in run , r = self._runner(client=self.ssh, name=self.shortname, **kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/run.py", line 455, in run 2021-07-28T11:21:49.996 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fe579e34b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x55815227d191] 2021-07-28T11:21:49.998 WARNING:scrape:Ignoring malparsed backtrace: Read #1:22300612:::benchmark_data_smithi172_446075_object166:head# , Read #1:2286461b:::benchmark_data_smithi172_446075_object51:head# , Read #1:22c8753f:::benchmark_data_smithi172_452300_object90:head# 2021-07-28T11:21:49.999 WARNING:scrape:Ignoring malparsed backtrace: Read #1:522ca259:::benchmark_data_smithi172_446075_object403:head# , Read #1:5233355e:::benchmark_data_smithi172_452300_object38:head# , Read #1:524e7399:::benchmark_data_smithi172_446075_object71:head# 2021-07-28T11:21:50.000 WARNING:scrape:Ignoring malparsed backtrace: Read #1:83885c48:::benchmark_data_smithi172_446075_object209:head# , Read #1:83a36c03:::benchmark_data_smithi172_446075_object335:head# , Read #1:83a59deb:::benchmark_data_smithi172_446075_object320:head# 2021-07-28T11:21:50.001 WARNING:scrape:Ignoring malparsed backtrace: Read #1:b85212b4:::benchmark_data_smithi172_446075_object169:head# , Read #1:b852f0c6:::benchmark_data_smithi172_446075_object231:head# , Read #1:b8615e71:::benchmark_last_metadata:head# 2021-07-28T11:21:50.002 WARNING:scrape:Ignoring malparsed backtrace: Read #1:eb8808f8:::benchmark_data_smithi172_446075_object41:head# , Read #1:eba2d310:::benchmark_data_smithi172_446075_object114:head# , Read #1:ebaeb98a:::benchmark_data_smithi172_446075_object124:head# 2021-07-28T11:21:50.002 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:37.847 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:89916d32:::benchmark_data_smithi172_446075_object99:head# , 2021-07-28T00:41:37.847 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:37.856 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:89edc045:::benchmark_data_smithi172_446075_object0:head# 2021-07-28T11:21:50.003 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:39.104 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:39.137 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:a88b3d5b:::benchmark_data_smithi172_446075_object164:head# , 2021-07-28T00:41:39.138 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:50.003 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:40.977 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:cfbc1e45:::benchmark_data_smithi172_446075_object336:head# , 2021-07-28T00:41:40.978 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:41.011 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:d0335db6:::benchmark_data_smithi172_446075_object281:head# 2021-07-28T11:21:50.004 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:42.752 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:42.777 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:ebffbb87:::benchmark_data_smithi172_446075_object12:head# , 2021-07-28T00:41:42.777 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:50.005 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:46.105 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:46.129 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:0450e97b:::benchmark_data_smithi172_446075_object121:head# , 2021-07-28T00:41:46.129 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:50.006 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:47.929 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:20489435:::benchmark_data_smithi172_446075_object230:head# , 2021-07-28T00:41:47.929 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:47.954 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:205459db:::benchmark_data_smithi172_446075_object117:head# 2021-07-28T11:21:50.007 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:49.981 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:50.014 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:40ac5710:::benchmark_data_smithi172_446075_object360:head# , 2021-07-28T00:41:50.015 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} 2021-07-28T11:21:50.007 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-28T00:41:51.780 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:5de4dc63:::benchmark_data_smithi172_446075_object333:head# , 2021-07-28T00:41:51.780 INFO:tasks.workunit.client.0.smithi172.stdout:snapset 0=[]:{} , 2021-07-28T00:41:51.805 INFO:tasks.workunit.client.0.smithi172.stdout:Write #1:5e546dc4:::benchmark_data_smithi172_446075_object40:head# 2021-07-28T11:21:50.008 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fecd0039b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x55b9ff7fd191] 2021-07-28T11:21:50.009 WARNING:scrape:Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/remote.py", line 509, in run , r = self._runner(client=self.ssh, name=self.shortname, **kwargs) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/run.py", line 455, in run 2021-07-28T11:21:50.093 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fbaa33fdb20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557549e35551] 2021-07-28T11:21:50.104 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fbaa33fdb20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557549e35551] 2021-07-28T11:21:50.116 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fbaa33fdb20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557549e35551] 2021-07-28T11:21:50.126 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fbaa33fdb20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557549e35551] 2021-07-28T11:21:50.137 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7fbaa33fdb20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557549e35551] 2021-07-28T11:21:50.697 WARNING:scrape:Misunderstood line: 2021-07-28T11:21:53.312 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f63d2e19b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x561a5954a191] 2021-07-28T11:21:53.313 WARNING:scrape:Ignoring malparsed backtrace: raise exc.exc_info[1] , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/parallel.py", line 23, in capture_traceback , return func(*args, **kwargs) 2021-07-28T11:21:53.354 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f63d2e19b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x561a5954a191] 2021-07-28T11:21:53.355 WARNING:scrape:Ignoring malparsed backtrace: raise exc.exc_info[1] , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/parallel.py", line 23, in capture_traceback , return func(*args, **kwargs) 2021-07-28T11:21:53.394 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f63d2e19b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x561a5954a191] 2021-07-28T11:21:53.395 WARNING:scrape:Ignoring malparsed backtrace: raise exc.exc_info[1] , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/parallel.py", line 23, in capture_traceback , return func(*args, **kwargs) 2021-07-28T11:21:53.441 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f63d2e19b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x561a5954a191] 2021-07-28T11:21:53.442 WARNING:scrape:Ignoring malparsed backtrace: raise exc.exc_info[1] , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/parallel.py", line 23, in capture_traceback , return func(*args, **kwargs) 2021-07-28T11:21:53.493 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f63d2e19b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x561a5954a191] 2021-07-28T11:21:53.495 WARNING:scrape:Ignoring malparsed backtrace: raise exc.exc_info[1] , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/parallel.py", line 23, in capture_traceback , return func(*args, **kwargs) 2021-07-28T11:21:53.535 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f63d2e19b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x561a5954a191] 2021-07-28T11:21:53.536 WARNING:scrape:Ignoring malparsed backtrace: raise exc.exc_info[1] , File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/parallel.py", line 23, in capture_traceback , return func(*args, **kwargs) 2021-07-28T11:21:54.296 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f44bb02db20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557a4dea4191] 2021-07-28T11:21:54.297 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:55.828 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:14ce082c:::obj-1-99:head# , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.298 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:57.759 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2a67e195:::obj-1-474:head# , 2021-07-27T23:11:57.760 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:57.818 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2aa852ff:::obj-1-5:head# 2021-07-28T11:21:54.298 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:59.917 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:3cf6835e:::obj-1-496:head# , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.299 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4ea8f99c:::obj-1-211:head# , 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:02.946 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2021-07-28T11:21:54.300 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:05.265 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:05.298 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:62b0aba9:::obj-1-253:head# , 2021-07-27T23:12:05.299 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.300 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:07.274 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d0da936:::obj-1-11:head# , 2021-07-27T23:12:07.275 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:07.307 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2021-07-28T11:21:54.301 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:09.392 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:986d245a:::obj-1-154:head# , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.302 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:11.550 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6aeed57:::obj-1-141:head# , 2021-07-27T23:12:11.551 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:11.625 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6dda70f:::obj-1-471:head# 2021-07-28T11:21:54.302 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:13.818 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:beb88be5:::obj-1-396:head# , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.303 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:15.718 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d511492e:::obj-1-388:head# , 2021-07-27T23:12:15.719 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:15.752 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d526a7fa:::obj-1-12:head# 2021-07-28T11:21:54.304 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:17.661 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:17.686 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:eb086660:::obj-1-595:head# , 2021-07-27T23:12:17.687 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.304 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffab306e:::obj-1-97:head# , 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:19.795 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffdfd397:::obj-1-433:head# 2021-07-28T11:21:54.305 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:23.312 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:11a4d2f6:::obj-fill-256:head# , 2021-07-27T23:12:23.313 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:23.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:12d52a31:::obj-fill-22:head# 2021-07-28T11:21:54.306 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:25.721 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:2a10cbb6:::obj-fill-228:head# , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.306 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:27.985 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# , 2021-07-27T23:12:27.986 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:28.022 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2021-07-28T11:21:54.307 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:30.164 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:55aaf8c4:::obj-fill-29:head# , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.307 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6ca7e551:::obj-fill-40:head# , 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:32.320 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2021-07-28T11:21:54.308 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:34.321 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:34.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:7efa3c6e:::obj-fill-408:head# , 2021-07-27T23:12:34.346 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.309 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8c774623:::obj-fill-38:head# , 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:36.413 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2021-07-28T11:21:54.309 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:38.397 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:38.430 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:a1897e34:::obj-fill-153:head# , 2021-07-27T23:12:38.431 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.310 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b53a3690:::obj-fill-264:head# , 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:40.656 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2021-07-28T11:21:54.311 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:42.715 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:42.748 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:cea7a728:::obj-fill-265:head# , 2021-07-27T23:12:42.749 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.311 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e38b1f4d:::obj-fill-393:head# , 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:45.066 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e4792474:::obj-fill-158:head# 2021-07-28T11:21:54.312 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:47.217 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:ffa355f7:::obj-fill-500:head# , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.313 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.314 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.314 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.315 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2021-07-28T11:21:54.316 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.316 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2021-07-28T11:21:54.317 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.318 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.319 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.319 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2021-07-28T11:21:54.320 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.321 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2021-07-28T11:21:54.322 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.322 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.323 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.324 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2021-07-28T11:21:54.324 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.325 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2021-07-28T11:21:54.326 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.326 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.327 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.328 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2021-07-28T11:21:54.329 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.329 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2021-07-28T11:21:54.330 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.331 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.332 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.332 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2021-07-28T11:21:54.333 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.334 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2021-07-28T11:21:54.335 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.335 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.336 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.337 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2021-07-28T11:21:54.337 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.338 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 179582 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-07-28T11:21:54.339 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local -a delays , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2021-07-28T11:21:54.340 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local expression , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2021-07-28T11:21:54.340 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: for s in $seqs , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: echo 1-219043332123 , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: cut -d - -f 1 2021-07-28T11:21:54.341 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it , pool 'fillpool' does not exist , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:540: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.342 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:17:51.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 , 2021-07-27T23:17:51.746 ERROR:teuthology.run_tasks:Saw exception from tasks. , Traceback (most recent call last): 2021-07-28T11:21:54.388 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f44bb02db20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557a4dea4191] 2021-07-28T11:21:54.389 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:55.828 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:14ce082c:::obj-1-99:head# , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.389 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:57.759 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2a67e195:::obj-1-474:head# , 2021-07-27T23:11:57.760 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:57.818 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2aa852ff:::obj-1-5:head# 2021-07-28T11:21:54.390 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:59.917 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:3cf6835e:::obj-1-496:head# , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.391 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4ea8f99c:::obj-1-211:head# , 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:02.946 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2021-07-28T11:21:54.391 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:05.265 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:05.298 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:62b0aba9:::obj-1-253:head# , 2021-07-27T23:12:05.299 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.392 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:07.274 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d0da936:::obj-1-11:head# , 2021-07-27T23:12:07.275 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:07.307 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2021-07-28T11:21:54.392 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:09.392 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:986d245a:::obj-1-154:head# , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.393 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:11.550 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6aeed57:::obj-1-141:head# , 2021-07-27T23:12:11.551 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:11.625 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6dda70f:::obj-1-471:head# 2021-07-28T11:21:54.393 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:13.818 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:beb88be5:::obj-1-396:head# , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.394 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:15.718 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d511492e:::obj-1-388:head# , 2021-07-27T23:12:15.719 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:15.752 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d526a7fa:::obj-1-12:head# 2021-07-28T11:21:54.395 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:17.661 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:17.686 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:eb086660:::obj-1-595:head# , 2021-07-27T23:12:17.687 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.395 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffab306e:::obj-1-97:head# , 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:19.795 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffdfd397:::obj-1-433:head# 2021-07-28T11:21:54.396 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:23.312 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:11a4d2f6:::obj-fill-256:head# , 2021-07-27T23:12:23.313 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:23.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:12d52a31:::obj-fill-22:head# 2021-07-28T11:21:54.396 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:25.721 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:2a10cbb6:::obj-fill-228:head# , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.397 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:27.985 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# , 2021-07-27T23:12:27.986 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:28.022 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2021-07-28T11:21:54.398 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:30.164 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:55aaf8c4:::obj-fill-29:head# , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.398 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6ca7e551:::obj-fill-40:head# , 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:32.320 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2021-07-28T11:21:54.399 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:34.321 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:34.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:7efa3c6e:::obj-fill-408:head# , 2021-07-27T23:12:34.346 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.399 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8c774623:::obj-fill-38:head# , 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:36.413 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2021-07-28T11:21:54.400 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:38.397 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:38.430 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:a1897e34:::obj-fill-153:head# , 2021-07-27T23:12:38.431 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.401 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b53a3690:::obj-fill-264:head# , 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:40.656 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2021-07-28T11:21:54.401 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:42.715 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:42.748 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:cea7a728:::obj-fill-265:head# , 2021-07-27T23:12:42.749 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.402 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e38b1f4d:::obj-fill-393:head# , 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:45.066 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e4792474:::obj-fill-158:head# 2021-07-28T11:21:54.403 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:47.217 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:ffa355f7:::obj-fill-500:head# , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.404 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.404 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.405 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.406 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2021-07-28T11:21:54.406 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.407 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2021-07-28T11:21:54.408 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.408 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.409 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.410 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2021-07-28T11:21:54.411 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.411 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2021-07-28T11:21:54.412 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.413 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.413 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.414 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2021-07-28T11:21:54.415 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.416 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2021-07-28T11:21:54.416 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.417 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.418 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.419 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2021-07-28T11:21:54.419 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.420 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2021-07-28T11:21:54.421 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.422 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.422 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.423 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2021-07-28T11:21:54.424 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.425 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2021-07-28T11:21:54.425 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.426 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.427 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.427 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2021-07-28T11:21:54.428 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.429 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 179582 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-07-28T11:21:54.429 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local -a delays , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2021-07-28T11:21:54.430 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local expression , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2021-07-28T11:21:54.431 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: for s in $seqs , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: echo 1-219043332123 , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: cut -d - -f 1 2021-07-28T11:21:54.431 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it , pool 'fillpool' does not exist , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:540: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.432 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:17:51.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 , 2021-07-27T23:17:51.746 ERROR:teuthology.run_tasks:Saw exception from tasks. , Traceback (most recent call last): 2021-07-28T11:21:54.478 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f44bb02db20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557a4dea4191] 2021-07-28T11:21:54.479 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:55.828 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:14ce082c:::obj-1-99:head# , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.479 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:57.759 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2a67e195:::obj-1-474:head# , 2021-07-27T23:11:57.760 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:57.818 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2aa852ff:::obj-1-5:head# 2021-07-28T11:21:54.480 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:59.917 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:3cf6835e:::obj-1-496:head# , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.481 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4ea8f99c:::obj-1-211:head# , 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:02.946 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2021-07-28T11:21:54.481 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:05.265 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:05.298 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:62b0aba9:::obj-1-253:head# , 2021-07-27T23:12:05.299 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.482 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:07.274 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d0da936:::obj-1-11:head# , 2021-07-27T23:12:07.275 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:07.307 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2021-07-28T11:21:54.482 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:09.392 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:986d245a:::obj-1-154:head# , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.483 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:11.550 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6aeed57:::obj-1-141:head# , 2021-07-27T23:12:11.551 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:11.625 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6dda70f:::obj-1-471:head# 2021-07-28T11:21:54.484 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:13.818 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:beb88be5:::obj-1-396:head# , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.484 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:15.718 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d511492e:::obj-1-388:head# , 2021-07-27T23:12:15.719 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:15.752 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d526a7fa:::obj-1-12:head# 2021-07-28T11:21:54.485 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:17.661 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:17.686 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:eb086660:::obj-1-595:head# , 2021-07-27T23:12:17.687 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.485 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffab306e:::obj-1-97:head# , 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:19.795 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffdfd397:::obj-1-433:head# 2021-07-28T11:21:54.486 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:23.312 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:11a4d2f6:::obj-fill-256:head# , 2021-07-27T23:12:23.313 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:23.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:12d52a31:::obj-fill-22:head# 2021-07-28T11:21:54.487 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:25.721 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:2a10cbb6:::obj-fill-228:head# , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.487 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:27.985 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# , 2021-07-27T23:12:27.986 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:28.022 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2021-07-28T11:21:54.488 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:30.164 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:55aaf8c4:::obj-fill-29:head# , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.488 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6ca7e551:::obj-fill-40:head# , 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:32.320 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2021-07-28T11:21:54.489 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:34.321 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:34.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:7efa3c6e:::obj-fill-408:head# , 2021-07-27T23:12:34.346 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.490 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8c774623:::obj-fill-38:head# , 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:36.413 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2021-07-28T11:21:54.490 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:38.397 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:38.430 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:a1897e34:::obj-fill-153:head# , 2021-07-27T23:12:38.431 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.491 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b53a3690:::obj-fill-264:head# , 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:40.656 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2021-07-28T11:21:54.491 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:42.715 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:42.748 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:cea7a728:::obj-fill-265:head# , 2021-07-27T23:12:42.749 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.492 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e38b1f4d:::obj-fill-393:head# , 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:45.066 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e4792474:::obj-fill-158:head# 2021-07-28T11:21:54.493 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:47.217 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:ffa355f7:::obj-fill-500:head# , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.493 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.494 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.495 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.495 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2021-07-28T11:21:54.496 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.497 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2021-07-28T11:21:54.497 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.498 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.499 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.500 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2021-07-28T11:21:54.500 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.501 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2021-07-28T11:21:54.502 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.502 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.503 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.504 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2021-07-28T11:21:54.504 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.505 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2021-07-28T11:21:54.506 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.506 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.507 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.508 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2021-07-28T11:21:54.508 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.509 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2021-07-28T11:21:54.510 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.511 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.511 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.512 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2021-07-28T11:21:54.513 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.513 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2021-07-28T11:21:54.514 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.515 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.515 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.516 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2021-07-28T11:21:54.517 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.517 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 179582 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-07-28T11:21:54.518 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local -a delays , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2021-07-28T11:21:54.519 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local expression , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2021-07-28T11:21:54.519 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: for s in $seqs , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: echo 1-219043332123 , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: cut -d - -f 1 2021-07-28T11:21:54.520 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it , pool 'fillpool' does not exist , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:540: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.521 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:17:51.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 , 2021-07-27T23:17:51.746 ERROR:teuthology.run_tasks:Saw exception from tasks. , Traceback (most recent call last): 2021-07-28T11:21:54.584 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f44bb02db20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557a4dea4191] 2021-07-28T11:21:54.585 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:55.828 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:14ce082c:::obj-1-99:head# , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.586 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:57.759 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2a67e195:::obj-1-474:head# , 2021-07-27T23:11:57.760 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:57.818 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2aa852ff:::obj-1-5:head# 2021-07-28T11:21:54.587 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:59.917 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:3cf6835e:::obj-1-496:head# , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.587 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4ea8f99c:::obj-1-211:head# , 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:02.946 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2021-07-28T11:21:54.588 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:05.265 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:05.298 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:62b0aba9:::obj-1-253:head# , 2021-07-27T23:12:05.299 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.589 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:07.274 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d0da936:::obj-1-11:head# , 2021-07-27T23:12:07.275 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:07.307 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2021-07-28T11:21:54.590 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:09.392 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:986d245a:::obj-1-154:head# , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.590 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:11.550 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6aeed57:::obj-1-141:head# , 2021-07-27T23:12:11.551 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:11.625 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6dda70f:::obj-1-471:head# 2021-07-28T11:21:54.591 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:13.818 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:beb88be5:::obj-1-396:head# , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.591 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:15.718 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d511492e:::obj-1-388:head# , 2021-07-27T23:12:15.719 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:15.752 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d526a7fa:::obj-1-12:head# 2021-07-28T11:21:54.592 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:17.661 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:17.686 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:eb086660:::obj-1-595:head# , 2021-07-27T23:12:17.687 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.593 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffab306e:::obj-1-97:head# , 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:19.795 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffdfd397:::obj-1-433:head# 2021-07-28T11:21:54.593 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:23.312 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:11a4d2f6:::obj-fill-256:head# , 2021-07-27T23:12:23.313 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:23.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:12d52a31:::obj-fill-22:head# 2021-07-28T11:21:54.594 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:25.721 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:2a10cbb6:::obj-fill-228:head# , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.594 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:27.985 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# , 2021-07-27T23:12:27.986 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:28.022 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2021-07-28T11:21:54.595 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:30.164 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:55aaf8c4:::obj-fill-29:head# , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.596 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6ca7e551:::obj-fill-40:head# , 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:32.320 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2021-07-28T11:21:54.596 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:34.321 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:34.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:7efa3c6e:::obj-fill-408:head# , 2021-07-27T23:12:34.346 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.597 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8c774623:::obj-fill-38:head# , 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:36.413 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2021-07-28T11:21:54.597 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:38.397 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:38.430 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:a1897e34:::obj-fill-153:head# , 2021-07-27T23:12:38.431 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.598 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b53a3690:::obj-fill-264:head# , 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:40.656 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2021-07-28T11:21:54.599 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:42.715 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:42.748 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:cea7a728:::obj-fill-265:head# , 2021-07-27T23:12:42.749 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.599 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e38b1f4d:::obj-fill-393:head# , 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:45.066 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e4792474:::obj-fill-158:head# 2021-07-28T11:21:54.600 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:47.217 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:ffa355f7:::obj-fill-500:head# , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.601 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.601 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.602 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.603 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2021-07-28T11:21:54.603 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.604 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2021-07-28T11:21:54.605 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.605 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.606 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.607 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2021-07-28T11:21:54.607 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.608 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2021-07-28T11:21:54.609 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.609 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.610 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.611 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2021-07-28T11:21:54.611 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.612 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2021-07-28T11:21:54.613 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.613 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.614 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.615 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2021-07-28T11:21:54.616 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.616 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2021-07-28T11:21:54.617 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.618 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.619 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.619 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2021-07-28T11:21:54.620 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.621 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2021-07-28T11:21:54.621 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.622 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.623 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.623 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2021-07-28T11:21:54.624 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.625 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 179582 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-07-28T11:21:54.625 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local -a delays , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2021-07-28T11:21:54.626 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local expression , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2021-07-28T11:21:54.627 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: for s in $seqs , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: echo 1-219043332123 , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: cut -d - -f 1 2021-07-28T11:21:54.628 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it , pool 'fillpool' does not exist , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:540: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.628 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:17:51.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 , 2021-07-27T23:17:51.746 ERROR:teuthology.run_tasks:Saw exception from tasks. , Traceback (most recent call last): 2021-07-28T11:21:54.675 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f44bb02db20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557a4dea4191] 2021-07-28T11:21:54.677 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:55.828 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:14ce082c:::obj-1-99:head# , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.677 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:57.759 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2a67e195:::obj-1-474:head# , 2021-07-27T23:11:57.760 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:57.818 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2aa852ff:::obj-1-5:head# 2021-07-28T11:21:54.678 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:59.917 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:3cf6835e:::obj-1-496:head# , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.679 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4ea8f99c:::obj-1-211:head# , 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:02.946 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2021-07-28T11:21:54.679 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:05.265 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:05.298 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:62b0aba9:::obj-1-253:head# , 2021-07-27T23:12:05.299 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.680 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:07.274 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d0da936:::obj-1-11:head# , 2021-07-27T23:12:07.275 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:07.307 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2021-07-28T11:21:54.681 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:09.392 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:986d245a:::obj-1-154:head# , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.681 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:11.550 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6aeed57:::obj-1-141:head# , 2021-07-27T23:12:11.551 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:11.625 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6dda70f:::obj-1-471:head# 2021-07-28T11:21:54.682 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:13.818 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:beb88be5:::obj-1-396:head# , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.682 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:15.718 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d511492e:::obj-1-388:head# , 2021-07-27T23:12:15.719 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:15.752 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d526a7fa:::obj-1-12:head# 2021-07-28T11:21:54.683 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:17.661 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:17.686 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:eb086660:::obj-1-595:head# , 2021-07-27T23:12:17.687 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.684 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffab306e:::obj-1-97:head# , 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:19.795 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffdfd397:::obj-1-433:head# 2021-07-28T11:21:54.684 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:23.312 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:11a4d2f6:::obj-fill-256:head# , 2021-07-27T23:12:23.313 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:23.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:12d52a31:::obj-fill-22:head# 2021-07-28T11:21:54.685 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:25.721 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:2a10cbb6:::obj-fill-228:head# , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.685 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:27.985 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# , 2021-07-27T23:12:27.986 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:28.022 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2021-07-28T11:21:54.686 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:30.164 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:55aaf8c4:::obj-fill-29:head# , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.687 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6ca7e551:::obj-fill-40:head# , 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:32.320 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2021-07-28T11:21:54.687 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:34.321 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:34.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:7efa3c6e:::obj-fill-408:head# , 2021-07-27T23:12:34.346 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.688 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8c774623:::obj-fill-38:head# , 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:36.413 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2021-07-28T11:21:54.689 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:38.397 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:38.430 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:a1897e34:::obj-fill-153:head# , 2021-07-27T23:12:38.431 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.689 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b53a3690:::obj-fill-264:head# , 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:40.656 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2021-07-28T11:21:54.690 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:42.715 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:42.748 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:cea7a728:::obj-fill-265:head# , 2021-07-27T23:12:42.749 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.691 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e38b1f4d:::obj-fill-393:head# , 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:45.066 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e4792474:::obj-fill-158:head# 2021-07-28T11:21:54.691 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:47.217 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:ffa355f7:::obj-fill-500:head# , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.692 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.693 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.693 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.694 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2021-07-28T11:21:54.695 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.695 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2021-07-28T11:21:54.696 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.697 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.697 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.698 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2021-07-28T11:21:54.699 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.700 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2021-07-28T11:21:54.700 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.701 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.702 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.702 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2021-07-28T11:21:54.703 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.704 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2021-07-28T11:21:54.704 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.705 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.706 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.707 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2021-07-28T11:21:54.707 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.708 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2021-07-28T11:21:54.709 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.710 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.710 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.711 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2021-07-28T11:21:54.712 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.712 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2021-07-28T11:21:54.713 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.714 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.715 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.715 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2021-07-28T11:21:54.716 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.717 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 179582 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-07-28T11:21:54.717 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local -a delays , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2021-07-28T11:21:54.718 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local expression , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2021-07-28T11:21:54.719 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: for s in $seqs , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: echo 1-219043332123 , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: cut -d - -f 1 2021-07-28T11:21:54.720 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it , pool 'fillpool' does not exist , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:540: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.720 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:17:51.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 , 2021-07-27T23:17:51.746 ERROR:teuthology.run_tasks:Saw exception from tasks. , Traceback (most recent call last): 2021-07-28T11:21:54.767 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f44bb02db20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557a4dea4191] 2021-07-28T11:21:54.768 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:55.828 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:14ce082c:::obj-1-99:head# , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.769 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:57.759 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2a67e195:::obj-1-474:head# , 2021-07-27T23:11:57.760 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:57.818 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2aa852ff:::obj-1-5:head# 2021-07-28T11:21:54.770 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:59.917 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:3cf6835e:::obj-1-496:head# , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.771 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4ea8f99c:::obj-1-211:head# , 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:02.946 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2021-07-28T11:21:54.771 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:05.265 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:05.298 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:62b0aba9:::obj-1-253:head# , 2021-07-27T23:12:05.299 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.772 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:07.274 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d0da936:::obj-1-11:head# , 2021-07-27T23:12:07.275 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:07.307 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2021-07-28T11:21:54.772 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:09.392 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:986d245a:::obj-1-154:head# , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.773 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:11.550 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6aeed57:::obj-1-141:head# , 2021-07-27T23:12:11.551 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:11.625 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6dda70f:::obj-1-471:head# 2021-07-28T11:21:54.774 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:13.818 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:beb88be5:::obj-1-396:head# , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.774 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:15.718 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d511492e:::obj-1-388:head# , 2021-07-27T23:12:15.719 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:15.752 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d526a7fa:::obj-1-12:head# 2021-07-28T11:21:54.775 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:17.661 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:17.686 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:eb086660:::obj-1-595:head# , 2021-07-27T23:12:17.687 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.775 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffab306e:::obj-1-97:head# , 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:19.795 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffdfd397:::obj-1-433:head# 2021-07-28T11:21:54.776 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:23.312 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:11a4d2f6:::obj-fill-256:head# , 2021-07-27T23:12:23.313 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:23.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:12d52a31:::obj-fill-22:head# 2021-07-28T11:21:54.777 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:25.721 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:2a10cbb6:::obj-fill-228:head# , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.777 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:27.985 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# , 2021-07-27T23:12:27.986 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:28.022 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2021-07-28T11:21:54.778 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:30.164 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:55aaf8c4:::obj-fill-29:head# , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.779 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6ca7e551:::obj-fill-40:head# , 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:32.320 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2021-07-28T11:21:54.779 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:34.321 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:34.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:7efa3c6e:::obj-fill-408:head# , 2021-07-27T23:12:34.346 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.780 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8c774623:::obj-fill-38:head# , 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:36.413 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2021-07-28T11:21:54.781 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:38.397 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:38.430 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:a1897e34:::obj-fill-153:head# , 2021-07-27T23:12:38.431 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.781 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b53a3690:::obj-fill-264:head# , 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:40.656 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2021-07-28T11:21:54.782 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:42.715 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:42.748 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:cea7a728:::obj-fill-265:head# , 2021-07-27T23:12:42.749 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.782 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e38b1f4d:::obj-fill-393:head# , 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:45.066 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e4792474:::obj-fill-158:head# 2021-07-28T11:21:54.783 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:47.217 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:ffa355f7:::obj-fill-500:head# , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.784 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.785 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.785 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.786 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2021-07-28T11:21:54.787 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.787 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2021-07-28T11:21:54.788 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.789 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.789 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.790 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2021-07-28T11:21:54.791 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.792 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2021-07-28T11:21:54.792 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.793 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.794 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.795 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2021-07-28T11:21:54.795 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.796 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2021-07-28T11:21:54.797 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.797 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.798 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.799 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2021-07-28T11:21:54.800 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.800 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2021-07-28T11:21:54.801 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.802 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.802 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.803 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2021-07-28T11:21:54.804 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.804 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2021-07-28T11:21:54.805 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.806 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.807 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.807 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2021-07-28T11:21:54.808 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.809 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 179582 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-07-28T11:21:54.809 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local -a delays , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2021-07-28T11:21:54.810 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local expression , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2021-07-28T11:21:54.811 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: for s in $seqs , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: echo 1-219043332123 , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: cut -d - -f 1 2021-07-28T11:21:54.811 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it , pool 'fillpool' does not exist , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:540: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.812 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:17:51.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 , 2021-07-27T23:17:51.746 ERROR:teuthology.run_tasks:Saw exception from tasks. , Traceback (most recent call last): 2021-07-28T11:21:54.867 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f44bb02db20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x557a4dea4191] 2021-07-28T11:21:54.868 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:55.828 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:14ce082c:::obj-1-99:head# , 2021-07-27T23:11:55.861 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.869 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:57.759 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2a67e195:::obj-1-474:head# , 2021-07-27T23:11:57.760 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:11:57.818 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:2aa852ff:::obj-1-5:head# 2021-07-28T11:21:54.869 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:11:59.917 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:3cf6835e:::obj-1-496:head# , 2021-07-27T23:12:00.001 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.870 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4ea8f99c:::obj-1-211:head# , 2021-07-27T23:12:02.896 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:02.946 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2021-07-28T11:21:54.870 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:05.265 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:05.298 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:62b0aba9:::obj-1-253:head# , 2021-07-27T23:12:05.299 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.871 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:07.274 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d0da936:::obj-1-11:head# , 2021-07-27T23:12:07.275 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:07.307 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2021-07-28T11:21:54.872 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:09.392 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:986d245a:::obj-1-154:head# , 2021-07-27T23:12:09.425 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.872 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:11.550 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6aeed57:::obj-1-141:head# , 2021-07-27T23:12:11.551 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:11.625 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:a6dda70f:::obj-1-471:head# 2021-07-28T11:21:54.873 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:13.818 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:beb88be5:::obj-1-396:head# , 2021-07-27T23:12:13.893 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.873 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:15.718 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d511492e:::obj-1-388:head# , 2021-07-27T23:12:15.719 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:15.752 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:d526a7fa:::obj-1-12:head# 2021-07-28T11:21:54.874 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:17.661 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:17.686 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:eb086660:::obj-1-595:head# , 2021-07-27T23:12:17.687 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.875 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffab306e:::obj-1-97:head# , 2021-07-27T23:12:19.762 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:19.795 INFO:tasks.workunit.client.0.smithi174.stdout:Write #2:ffdfd397:::obj-1-433:head# 2021-07-28T11:21:54.875 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:23.312 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:11a4d2f6:::obj-fill-256:head# , 2021-07-27T23:12:23.313 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:23.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:12d52a31:::obj-fill-22:head# 2021-07-28T11:21:54.876 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:25.721 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:2a10cbb6:::obj-fill-228:head# , 2021-07-27T23:12:25.756 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.876 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:27.985 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# , 2021-07-27T23:12:27.986 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:28.022 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2021-07-28T11:21:54.877 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:30.164 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:55aaf8c4:::obj-fill-29:head# , 2021-07-27T23:12:30.208 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.877 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6ca7e551:::obj-fill-40:head# , 2021-07-27T23:12:32.237 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:32.320 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2021-07-28T11:21:54.878 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:34.321 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:34.345 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:7efa3c6e:::obj-fill-408:head# , 2021-07-27T23:12:34.346 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.879 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8c774623:::obj-fill-38:head# , 2021-07-27T23:12:36.380 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:36.413 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2021-07-28T11:21:54.879 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:38.397 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:38.430 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:a1897e34:::obj-fill-153:head# , 2021-07-27T23:12:38.431 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.880 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b53a3690:::obj-fill-264:head# , 2021-07-27T23:12:40.581 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:40.656 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2021-07-28T11:21:54.880 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:42.715 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:42.748 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:cea7a728:::obj-fill-265:head# , 2021-07-27T23:12:42.749 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.881 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e38b1f4d:::obj-fill-393:head# , 2021-07-27T23:12:45.024 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:45.066 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:e4792474:::obj-fill-158:head# 2021-07-28T11:21:54.882 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:12:47.217 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:Write #1:ffa355f7:::obj-fill-500:head# , 2021-07-27T23:12:47.250 INFO:tasks.workunit.client.0.smithi174.stdout:snapset 0=[]:{} 2021-07-28T11:21:54.882 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.883 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.884 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.885 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2021-07-28T11:21:54.885 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.886 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2021-07-28T11:21:54.887 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.887 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.888 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.889 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2021-07-28T11:21:54.889 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.890 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2021-07-28T11:21:54.891 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.891 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.892 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.893 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2021-07-28T11:21:54.893 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.894 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2021-07-28T11:21:54.895 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.895 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.896 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.897 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2021-07-28T11:21:54.897 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.898 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2021-07-28T11:21:54.899 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.899 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.900 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.901 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2021-07-28T11:21:54.901 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.902 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2021-07-28T11:21:54.903 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.903 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.904 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2021-07-28T11:21:54.905 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2021-07-28T11:21:54.905 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:504: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:502: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2021-07-28T11:21:54.906 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 179582 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-07-28T11:21:54.907 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local -a delays , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -i loop=0 , /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:59: wait_for_not_state: flush_pg_stats 2021-07-28T11:21:54.907 WARNING:scrape:Ignoring malparsed backtrace: //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:44: get_num_in_state: local state=backfilling , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local expression , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: expression+='select(contains("backfilling"))' 2021-07-28T11:21:54.908 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: for s in $seqs , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: echo 1-219043332123 , //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: cut -d - -f 1 2021-07-28T11:21:54.909 WARNING:scrape:Ignoring malparsed backtrace: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it , pool 'fillpool' does not exist , //home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:540: TEST_backfill_multi_partial: seq 1 2 2021-07-28T11:21:54.909 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T23:17:51.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 , 2021-07-27T23:17:51.746 ERROR:teuthology.run_tasks:Saw exception from tasks. , Traceback (most recent call last): 2021-07-28T11:21:56.558 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 2021-07-28T11:21:56.560 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T22:39:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , 2021-07-27T22:39:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-07-28T11:21:56.613 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 2021-07-28T11:21:56.615 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T22:39:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , 2021-07-27T22:39:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-07-28T11:21:56.668 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 2021-07-28T11:21:56.669 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T22:39:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , 2021-07-27T22:39:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-07-28T11:21:56.740 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 2021-07-28T11:21:56.741 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T22:39:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , 2021-07-27T22:39:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-07-28T11:21:56.793 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 2021-07-28T11:21:56.794 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T22:39:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , 2021-07-27T22:39:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-07-28T11:21:56.847 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 2021-07-28T11:21:56.849 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T22:39:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , 2021-07-27T22:39:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-07-28T11:21:56.903 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 2021-07-28T11:21:56.904 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T22:39:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , 2021-07-27T22:39:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-07-28T11:21:56.968 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 2021-07-28T11:21:56.969 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T22:39:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , 2021-07-27T22:39:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-07-28T11:21:57.033 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) , 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] , 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 2021-07-28T11:21:57.034 WARNING:scrape:Ignoring malparsed backtrace: 2021-07-27T22:39:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , 2021-07-27T22:39:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq , gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-07-28T11:22:08.190 INFO:scrape:Found 15 distinct failure reasons 2021-07-28T11:22:08.193 INFO:scrape:Dead: b'2021-07-28T08:59:35.508 DEBUG:teuthology.exit:Finished running handlers' 2021-07-28T11:22:08.193 INFO:scrape:23 jobs: ['6296280', '6296372', '6296186', '6296523', '6296327', '6296258', '6296472', '6296330', '6296397', '6296273', '6296437', '6296473', '6296442', '6296209', '6296508', '6296461', '6296361', '6296341', '6296336', '6296411', '6296259', '6296422', '6296204'] 2021-07-28T11:22:08.194 INFO:scrape:suites intersection: ['rados', 'thrashosds-health'] 2021-07-28T11:22:08.194 INFO:scrape:suites union: ['1-install/nautilus-v1only', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/{fixed-2', 'clusters/{fixed-4', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{centos_latest}', 'fast/fast', 'fast/normal', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{centos_8.stream}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-agent-big}', 'workloads/cache-agent-small}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=3-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects-balanced}', 'workloads/pool-snaps-few-objects}', 'workloads/redirect_promote_tests}', 'workloads/small-objects}', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects}'] 2021-07-28T11:22:08.195 INFO:scrape: 2021-07-28T11:22:08.195 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi013 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-07-28T11:22:08.196 INFO:scrape:2 jobs: ['6296306', '6296486'] 2021-07-28T11:22:08.196 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{centos_8.2_kubic_stable', 'tasks/e2e}'] 2021-07-28T11:22:08.197 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{centos_8.2_kubic_stable', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'tasks/e2e}'] 2021-07-28T11:22:08.198 INFO:scrape: 2021-07-28T11:22:08.199 INFO:scrape:Failure: Command failed (workunit test osd/pg-split-merge.sh) on smithi172 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/pg-split-merge.sh' 2021-07-28T11:22:08.200 INFO:scrape:1 jobs: ['6296497'] 2021-07-28T11:22:08.200 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_8.stream}', 'workloads/osd}'] 2021-07-28T11:22:08.201 INFO:scrape: 2021-07-28T11:22:08.202 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-bluestore 20" ceph_test_objectstore --gtest_filter=*SyntheticMatrixC*/2 --gtest_catch_exceptions=0\'' 2021-07-28T11:22:08.203 INFO:scrape:1 jobs: ['6296511'] 2021-07-28T11:22:08.204 INFO:scrape:suites: ['rados/objectstore/{backends/objectstore-bluestore-b', 'supported-random-distro$/{rhel_8}}'] 2021-07-28T11:22:08.204 INFO:scrape: 2021-07-28T11:22:08.205 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2021-07-28T11:22:08.205 INFO:scrape:1 jobs: ['6296505'] 2021-07-28T11:22:08.205 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'thrashosds-health}', 'validater/valgrind}'] 2021-07-28T11:22:08.206 INFO:scrape: 2021-07-28T11:22:08.206 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json 2021-07-28T11:22:08.207 INFO:scrape:1 jobs: ['6296352'] 2021-07-28T11:22:08.207 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/fast', 'mon_election/classic', 'msgr-failures/fastclose', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-small-objects-many-deletes}'] 2021-07-28T11:22:08.208 INFO:scrape: 2021-07-28T11:22:08.208 INFO:scrape:Valgrind: osd (InvalidRead) 2021-07-28T11:22:08.209 INFO:scrape:1 jobs: ['6296338'] 2021-07-28T11:22:08.209 INFO:scrape:suites: ['2-inject-leak/none', 'centos_latest}', 'rados/valgrind-leaks/{1-start'] 2021-07-28T11:22:08.209 INFO:scrape: 2021-07-28T11:22:08.210 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/load-gen-mix-small.sh 2021-07-28T11:22:08.210 INFO:scrape:1 jobs: ['6296467'] 2021-07-28T11:22:08.211 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'supported-random-distro$/{centos_8}}', 'thrashosds-health}'] 2021-07-28T11:22:08.211 INFO:scrape: 2021-07-28T11:22:08.212 INFO:scrape:Failure: Command failed (workunit test erasure-code/test-erasure-eio.sh) on smithi012 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh' 2021-07-28T11:22:08.212 INFO:scrape:1 jobs: ['6296296'] 2021-07-28T11:22:08.212 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{rhel_8}', 'workloads/erasure-code}'] 2021-07-28T11:22:08.213 INFO:scrape: 2021-07-28T11:22:08.213 INFO:scrape:Timeout 120 running ceph --cluster ceph quorum_status 2021-07-28T11:22:08.214 INFO:scrape:1 jobs: ['6296417'] 2021-07-28T11:22:08.214 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/force-sync-many', 'workloads/pool-create-delete}'] 2021-07-28T11:22:08.215 INFO:scrape: 2021-07-28T11:22:08.215 INFO:scrape:Failure: Command failed (workunit test osd-backfill/osd-backfill-space.sh) on smithi174 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh' 2021-07-28T11:22:08.215 INFO:scrape:1 jobs: ['6296456'] 2021-07-28T11:22:08.216 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_8}', 'workloads/osd-backfill}'] 2021-07-28T11:22:08.216 INFO:scrape: 2021-07-28T11:22:08.217 INFO:scrape:Failure: reached maximum tries (800) after waiting for 4800 seconds 2021-07-28T11:22:08.217 INFO:scrape:4 jobs: ['6296386', '6296244', '6296535', '6296531'] 2021-07-28T11:22:08.218 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'openstack}', 'rados', 'thrashosds-health'] 2021-07-28T11:22:08.218 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/normal', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'fast/normal', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{centos_8.stream}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/default', 'thrashers/pggrow', 'thrashosds-health', 'workloads/admin_socket_objecter_requests}', 'workloads/ec-radosbench}', 'workloads/radosbench}'] 2021-07-28T11:22:08.219 INFO:scrape: 2021-07-28T11:22:08.219 INFO:scrape:Failure: ++ sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --pgid 11.0s0 --op list ++ grep '"oid":"repair_test_obj"' Error getting attr on : 11.0s0_head,0#11:00000000::::head#, (61) No data available + object='["11.0s0",{"oid":"repair_test_obj","key":"","snapid":-2,"hash":1039565829,"max":0,"pool":11,"namespace":"","shard_id":0,"max":0}]' + sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --pgid 11.0s0 '["11.0s0",{"oid":"repair_test_obj","key":"","snapid":-2,"hash":1039565829,"max":0,"pool":11,"namespace":"","shard_id":0,"max":0}]' rm-attr hinfo_key *** Caught signal (Segmentation fault) ** in thread 7f450d430ec0 thread_name:ceph-objectstor ceph version 17.0.0-6093-gfab3b8e8 (fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9) quincy (dev) 1: /lib64/libpthread.so.0(+0x12b20) [0x7f450a673b20] 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x556514e28191] 3: (BlueStore::umount()+0x13f) [0x556514e6f04f] 4: main() 5: __libc_start_main() 6: _start() 2021-07-28T11:22:08.220 INFO:scrape:1 jobs: ['6296431'] 2021-07-28T11:22:08.220 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{centos_8.stream}', 'tasks/repair_test}'] 2021-07-28T11:22:08.220 INFO:scrape: 2021-07-28T11:22:08.221 INFO:scrape:Failure: {'Failure object was': {'smithi162.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"} 2021-07-28T11:22:08.221 INFO:scrape:1 jobs: ['6296315'] 2021-07-28T11:22:08.222 INFO:scrape:suites: ['2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'mon_election/classic}', 'rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9'] 2021-07-28T11:22:08.222 INFO:scrape: 2021-07-28T11:22:08.223 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi091 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fab3b8e8cab5dd0ba00d8f0232dc48c22512b9e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh' 2021-07-28T11:22:08.223 INFO:scrape:1 jobs: ['6296536'] 2021-07-28T11:22:08.223 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{rhel_8}', 'workloads/scrub}'] 2021-07-28T11:22:08.224 INFO:scrape: