2023-06-26T02:38:56.405 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-26T02:38:56.406 INFO:teuthology.results:seed: '538' 2023-06-26T02:39:54.420 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-26T02:39:54.424 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-26T14:40:44.368 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2023-06-26T14:41:10.943 INFO:scrape:Found 6 jobs 2023-06-26T14:46:40.603 WARNING:scrape:Ignoring malparsed backtrace: ceph version 18.0.0-4444-g6e29bf32 (6e29bf323ce1af97210bf5c3ab6386cc214ed162) reef (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55f7bc4303c8] , 2: (KernelDevice::_aio_thread()+0x9bc) [0x55f7bccea7ac] 2023-06-26T14:46:40.727 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:15:19.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 , 2023-06-26T09:15:19.548 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.5GqVoX890yxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) , 2023-06-26T09:15:20.276 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph 2023-06-26T14:46:40.728 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:15:36.497 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAz/5hkaOWpNRAAKVQC7OQoXm2lg00Ik25ZdQ== 172.21.15.22:6789:/scratch /tmp/tmp.cOt8vMii3Ascratch , 2023-06-26T09:15:36.497 INFO:teuthology.orchestra.run.smithi022.stdout: , 2023-06-26T09:15:37.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~33s 2023-06-26T14:46:40.729 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:15:52.885 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/575 , 2023-06-26T09:15:52.885 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/575 , 2023-06-26T09:15:52.885 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-06-26T14:46:40.729 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:16:19.316 INFO:teuthology.orchestra.run.smithi022.stdout: , 2023-06-26T09:16:19.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 , 2023-06-26T09:16:19.408 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.5GqVoX890yxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-06-26T14:46:40.730 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:16:37.666 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph , 2023-06-26T09:16:37.685 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:13:24 UTC 2023 , 2023-06-26T09:16:37.691 INFO:teuthology.orchestra.run.smithi022.stdout:MKFS_OPTIONS -- 172.21.15.22:6789:/scratch 2023-06-26T14:46:40.730 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:17:16.603 INFO:teuthology.orchestra.run.smithi022.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAz/5hkaOWpNRAAKVQC7OQoXm2lg00Ik25ZdQ== 172.21.15.22:6789:/scratch /tmp/tmp.cOt8vMii3Ascratch , 2023-06-26T09:17:16.603 INFO:teuthology.orchestra.run.smithi022.stdout: , 2023-06-26T09:17:17.711 INFO:teuthology.orchestra.run.smithi022.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-26T14:46:40.730 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:17:33.432 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/608 , 2023-06-26T09:17:33.433 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests , 2023-06-26T09:17:33.439 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-06-26T14:46:40.731 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:18:29.606 INFO:teuthology.orchestra.run.smithi022.stdout:Ran: generic/616 , 2023-06-26T09:18:29.607 INFO:teuthology.orchestra.run.smithi022.stdout:Not run: generic/616 , 2023-06-26T09:18:29.607 INFO:teuthology.orchestra.run.smithi022.stdout:Passed all 1 tests 2023-06-26T14:46:40.732 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:18:40.417 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.5GqVoX890yxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) , 2023-06-26T09:18:40.830 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph , 2023-06-26T09:18:40.840 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:13:24 UTC 2023 2023-06-26T14:46:40.732 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.718 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.718 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.718 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory 2023-06-26T14:46:40.733 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged0: not mounted. , 2023-06-26T09:19:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory 2023-06-26T14:46:40.733 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory 2023-06-26T14:46:40.734 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged3: not mounted. 2023-06-26T14:46:40.734 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory 2023-06-26T14:46:40.735 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory 2023-06-26T14:46:40.735 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory 2023-06-26T14:46:40.797 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf' , 2023-06-26T09:19:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: +: No such file or directory 2023-06-26T14:46:40.798 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.825 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.826 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.826 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory 2023-06-26T14:46:40.799 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.839 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.839 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.839 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-26T14:46:40.800 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.851 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.852 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.852 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory 2023-06-26T14:46:40.801 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.864 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.865 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.865 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory 2023-06-26T14:46:40.802 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.878 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.878 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.878 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged1: not mounted. 2023-06-26T14:46:40.803 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.891 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged4: not mounted. , 2023-06-26T09:19:20.891 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:20.891 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory 2023-06-26T14:46:40.804 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.904 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged1: not mounted. , 2023-06-26T09:19:20.904 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.904 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory 2023-06-26T14:46:40.804 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.917 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.917 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.918 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged2: not mounted. 2023-06-26T14:46:40.805 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.931 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.931 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.931 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged4: not mounted.umount: 2023-06-26T14:46:40.805 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.944 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.944 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.944 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory 2023-06-26T14:46:40.806 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.957 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:20.957 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.957 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory 2023-06-26T14:46:40.806 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.970 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged2: not mounted. , 2023-06-26T09:19:20.970 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: mount: /tmp/tmp.cOt8vMii3Ascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cOt8vMii3Ascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:20.970 INFO:teuthology.orchestra.run.smithi022.stdout: + 2023-06-26T14:46:40.807 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:20.987 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.987 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:20.987 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged2: not mounted. 2023-06-26T14:46:40.807 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.000 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.001 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.001 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory 2023-06-26T14:46:40.807 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.013 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.014 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.014 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory 2023-06-26T14:46:40.808 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.026 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.026 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.027 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory 2023-06-26T14:46:40.808 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.039 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged1: not mounted. , 2023-06-26T09:19:21.039 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.040 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory 2023-06-26T14:46:40.809 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.052 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.053 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged0: not mounted. , 2023-06-26T09:19:21.053 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-26T14:46:40.809 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.066 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.066 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf' , 2023-06-26T09:19:21.066 INFO:teuthology.orchestra.run.smithi022.stdout: +: No such file or directory 2023-06-26T14:46:40.810 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.079 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.079 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.079 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory 2023-06-26T14:46:40.810 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.092 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.092 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.092 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory 2023-06-26T14:46:40.811 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.105 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.105 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.105 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory 2023-06-26T14:46:40.811 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.118 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.118 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.118 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-26T14:46:40.812 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.131 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.131 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged0: not mounted. , 2023-06-26T09:19:21.131 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-26T14:46:40.812 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.144 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.144 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.144 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged3: not mounted. 2023-06-26T14:46:40.813 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.160 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.160 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.160 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged1: not mounted. 2023-06-26T14:46:40.813 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.173 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.173 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.173 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory 2023-06-26T14:46:40.814 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.186 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.186 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.187 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory 2023-06-26T14:46:40.814 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.200 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.200 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.200 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory 2023-06-26T14:46:40.815 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.213 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.213 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged4: not mounted. , 2023-06-26T09:19:21.213 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-26T14:46:40.815 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.226 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.226 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged2: not mounted. , 2023-06-26T09:19:21.226 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged3: not mounted. 2023-06-26T14:46:40.816 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.239 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.239 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.239 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory 2023-06-26T14:46:40.816 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.252 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.252 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.252 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory 2023-06-26T14:46:40.817 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.265 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.265 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.266 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory 2023-06-26T14:46:40.817 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.278 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged5: not mounted. , 2023-06-26T09:19:21.278 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.279 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory 2023-06-26T14:46:40.817 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.291 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.291 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.292 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory 2023-06-26T14:46:40.818 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.305 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged5/etc/access.conf': No such file or directorymv: , 2023-06-26T09:19:21.305 INFO:teuthology.orchestra.run.smithi022.stdout: +cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.305 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory 2023-06-26T14:46:40.818 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.318 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.318 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.318 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory 2023-06-26T14:46:40.819 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory 2023-06-26T14:46:40.820 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.345 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory 2023-06-26T14:46:40.820 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.358 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged1: not mounted. , 2023-06-26T09:19:21.358 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: mount: /tmp/tmp.cOt8vMii3Ascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cOt8vMii3Ascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.358 INFO:teuthology.orchestra.run.smithi022.stdout: + 2023-06-26T14:46:40.821 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.371 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged0/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.371 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged0: not mounted. , 2023-06-26T09:19:21.372 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-26T14:46:40.822 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.386 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.386 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.386 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged2: not mounted. 2023-06-26T14:46:40.822 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.400 INFO:teuthology.orchestra.run.smithi022.stdout: + , 2023-06-26T09:19:21.400 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged2/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.400 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged1/etc/access.conf': No such file or directory 2023-06-26T14:46:40.823 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.416 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.416 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.416 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged3/etc/access.conf': No such file or directory 2023-06-26T14:46:40.823 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.429 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.429 INFO:teuthology.orchestra.run.smithi022.stdout: +mv: cannot stat '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory , 2023-06-26T09:19:21.429 INFO:teuthology.orchestra.run.smithi022.stdout: +touch: cannot touch '/tmp/tmp.cOt8vMii3Ascratch/merged4/etc/access.conf': No such file or directory 2023-06-26T14:46:40.824 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:21.442 INFO:teuthology.orchestra.run.smithi022.stdout: +umount: /tmp/tmp.cOt8vMii3Ascratch/merged5: not mounted. , 2023-06-26T09:19:21.442 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. , 2023-06-26T09:19:21.442 INFO:teuthology.orchestra.run.smithi022.stdout: +mount: /tmp/tmp.cOt8vMii3Ascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-26T14:46:40.825 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:19:29.804 DEBUG:teuthology.orchestra.run.smithi022:> (cd /tmp/tmp.5GqVoX890yxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) , 2023-06-26T09:19:30.231 INFO:teuthology.orchestra.run.smithi022.stdout:FSTYP -- ceph , 2023-06-26T09:19:30.241 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM -- Linux/x86_64 smithi022 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:13:24 UTC 2023 2023-06-26T14:46:40.826 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:20:08.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~305s , 2023-06-26T09:20:08.614 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons , 2023-06-26T09:20:08.614 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-06-26T14:46:40.827 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:20:29.316+0000 7fdd4ac7b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd440ce990 con 0x7fdd4415bc00 , 2023-06-26T09:20:29.316+0000 7fdd4ac7b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4415bfd0 con 0x7fdd440d0470 , 2023-06-26T09:20:29.316+0000 7fdd4ac7b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd440d1ff0 con 0x7fdd440b1150 2023-06-26T14:46:40.828 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:20:30.056+0000 7f3d1e5a3640 1 Processor -- start , 2023-06-26T09:20:30.056+0000 7f3d1e5a3640 1 -- start start , 2023-06-26T09:20:30.056+0000 7f3d1e5a3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d180b1150 0x7f3d1814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-26T14:46:40.829 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:20:30.744+0000 7f12f57fa640 1 --2- 172.21.15.22:0/821929006 >> [v2:172.21.15.22:6832/2970477677,v1:172.21.15.22:6833/2970477677] conn(0x7f12dc066280 0x7f12dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect , 2023-06-26T09:20:30.744+0000 7f12f57fa640 1 -- 172.21.15.22:0/821929006 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f12ec11e890 con 0x7f12f80cc740 , 2023-06-26T09:20:30.744+0000 7f12f7fff640 1 --2- 172.21.15.22:0/821929006 >> [v2:172.21.15.22:6832/2970477677,v1:172.21.15.22:6833/2970477677] conn(0x7f12dc066280 0x7f12dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-26T14:46:40.829 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:20:33.240+0000 7ff991ee6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98c0d1760 con 0x7ff98c0cc6b0 , 2023-06-26T09:20:33.240+0000 7ff991ee6640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c0cfc30 con 0x7ff98c0b41f0 , 2023-06-26T09:20:33.240+0000 7ff991ee6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0ce690 con 0x7ff98c15b680 2023-06-26T14:46:40.830 WARNING:scrape:Ignoring malparsed backtrace: tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 , /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 , /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 2023-06-26T14:46:40.830 WARNING:scrape:Ignoring malparsed backtrace: rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory , 2023-06-26T09:20:33.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2023-06-26T09:20:35.602 INFO:tasks.ceph.osd.0:Sent signal 15 2023-06-26T14:46:40.831 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T09:37:10.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T09:37:10.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T09:37:40.119 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.831 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T10:02:13.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T10:02:44.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T10:02:44.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.832 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T10:27:47.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T10:27:47.909 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T10:28:18.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.832 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T10:52:51.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T10:53:21.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T10:53:21.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.832 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T11:18:25.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T11:18:25.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T11:18:55.439 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.833 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T11:43:29.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T11:43:59.252 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T11:43:59.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.833 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T12:09:02.602 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T12:09:02.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T12:09:32.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.834 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T12:34:06.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T12:34:36.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T12:34:36.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.834 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T12:59:39.892 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T12:59:39.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T13:00:09.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.835 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T13:24:43.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T13:25:13.612 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T13:25:13.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.835 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T13:50:17.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T13:50:17.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T13:50:47.469 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:40.836 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T14:15:21.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T14:15:51.456 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf , 2023-06-26T14:15:51.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-26T14:46:41.559 WARNING:scrape:Missing log /home/teuthworker/archive/xiubli-2023-06-26_02:38:43-fs:functional-wip-lxb-xlock-20230619-0716-distro-default-smithi/7316102/remote/smithi062/log/ceph-osd.6.log.gz 2023-06-26T14:46:41.561 WARNING:scrape:Missing log /home/teuthworker/archive/xiubli-2023-06-26_02:38:43-fs:functional-wip-lxb-xlock-20230619-0716-distro-default-smithi/7316102/remote/smithi062/log/ceph-mgr.x.log.gz 2023-06-26T14:46:41.562 WARNING:scrape:Not-understood crash indication 2023-06-26T14:46:43.202 INFO:scrape:Found 3 distinct failure reasons 2023-06-26T14:46:43.203 INFO:scrape:Dead: b'2023-06-26T14:46:29.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-06-26T14:46:43.203 INFO:scrape:3 jobs: ['7316102', '7316101', '7316098'] 2023-06-26T14:46:43.204 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/xfstests-dev}'] 2023-06-26T14:46:43.204 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/xfstests-dev}'] 2023-06-26T14:46:43.205 INFO:scrape: 2023-06-26T14:46:43.245 INFO:scrape:Failure: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-26T14:46:43.248 INFO:scrape:2 jobs: ['7316097', '7316099'] 2023-06-26T14:46:43.248 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/xfstests-dev}'] 2023-06-26T14:46:43.249 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/xfstests-dev}'] 2023-06-26T14:46:43.252 INFO:scrape: 2023-06-26T14:46:43.253 INFO:scrape:Crash: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-26T14:46:43.254 INFO:scrape:ceph version 18.0.0-4444-g6e29bf32 (6e29bf323ce1af97210bf5c3ab6386cc214ed162) reef (dev) 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f62fa276ce0] 2: gsignal() 3: abort() 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55ad5c1d9dc3] 5: (KernelDevice::_aio_thread()+0x1798) [0x55ad5cdecbb8] 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55ad5cdef251] 7: /lib64/libpthread.so.0(+0x81cf) [0x7f62fa26c1cf] 8: clone() 2023-06-26T14:46:43.255 INFO:scrape:1 jobs: ['7316100'] 2023-06-26T14:46:43.256 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/xfstests-dev}'] 2023-06-26T14:46:43.256 INFO:scrape: